-- Logs begin at Fri 2022-06-17 10:40:50 UTC, end at Fri 2022-06-17 12:04:48 UTC. -- Jun 17 11:31:47.751694 dv-cinder-837166-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 17 11:31:47.760915 dv-cinder-837166-3-iscsi devstack@n-api.service[110435]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 17 11:31:47.762817 dv-cinder-837166-3-iscsi devstack@n-api.service[110435]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 17 11:31:47 2022] *** Jun 17 11:31:47.762817 dv-cinder-837166-3-iscsi devstack@n-api.service[110435]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 17 11:31:47.762817 dv-cinder-837166-3-iscsi devstack@n-api.service[110435]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 17 11:31:47.762817 dv-cinder-837166-3-iscsi devstack@n-api.service[110435]: nodename: dv-cinder-837166-3-iscsi Jun 17 11:31:47.762817 dv-cinder-837166-3-iscsi devstack@n-api.service[110435]: machine: x86_64 Jun 17 11:31:47.762817 dv-cinder-837166-3-iscsi devstack@n-api.service[110435]: clock source: unix Jun 17 11:31:47.762817 dv-cinder-837166-3-iscsi devstack@n-api.service[110435]: pcre jit disabled Jun 17 11:31:47.762817 dv-cinder-837166-3-iscsi devstack@n-api.service[110435]: detected number of CPU cores: 4 Jun 17 11:31:47.762817 dv-cinder-837166-3-iscsi devstack@n-api.service[110435]: current working directory: / Jun 17 11:31:47.762817 dv-cinder-837166-3-iscsi devstack@n-api.service[110435]: detected binary path: /usr/bin/uwsgi-core Jun 17 11:31:47.762817 dv-cinder-837166-3-iscsi devstack@n-api.service[110435]: your processes number limit is 47680 Jun 17 11:31:47.762817 dv-cinder-837166-3-iscsi devstack@n-api.service[110435]: your memory page size is 4096 bytes Jun 17 11:31:47.762817 dv-cinder-837166-3-iscsi devstack@n-api.service[110435]: detected max file descriptor number: 2048 Jun 17 11:31:47.762817 dv-cinder-837166-3-iscsi devstack@n-api.service[110435]: lock engine: pthread robust mutexes Jun 17 11:31:47.763920 dv-cinder-837166-3-iscsi devstack@n-api.service[110435]: thunder lock: enabled Jun 17 11:31:47.763920 dv-cinder-837166-3-iscsi devstack@n-api.service[110435]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 17 11:31:47.763920 dv-cinder-837166-3-iscsi devstack@n-api.service[110435]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 17 11:31:47.807036 dv-cinder-837166-3-iscsi devstack@n-api.service[110435]: Python main interpreter initialized at 0x55f8201c19c0 Jun 17 11:31:47.807036 dv-cinder-837166-3-iscsi devstack@n-api.service[110435]: python threads support enabled Jun 17 11:31:47.807036 dv-cinder-837166-3-iscsi devstack@n-api.service[110435]: your server socket listen backlog is limited to 100 connections Jun 17 11:31:47.807036 dv-cinder-837166-3-iscsi devstack@n-api.service[110435]: your mercy for graceful operations on workers is 90 seconds Jun 17 11:31:47.807460 dv-cinder-837166-3-iscsi devstack@n-api.service[110435]: mapped 403077 bytes (393 KB) for 2 cores Jun 17 11:31:47.807460 dv-cinder-837166-3-iscsi devstack@n-api.service[110435]: *** Operational MODE: preforking *** Jun 17 11:31:47.807734 dv-cinder-837166-3-iscsi devstack@n-api.service[110435]: *** uWSGI is running in multiple interpreter mode *** Jun 17 11:31:47.807734 dv-cinder-837166-3-iscsi devstack@n-api.service[110435]: spawned uWSGI master process (pid: 110435) Jun 17 11:31:47.807938 dv-cinder-837166-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 17 11:31:47.809691 dv-cinder-837166-3-iscsi devstack@n-api.service[110435]: spawned uWSGI worker 1 (pid: 110436, cores: 1) Jun 17 11:31:47.809691 dv-cinder-837166-3-iscsi devstack@n-api.service[110435]: spawned uWSGI worker 2 (pid: 110437, cores: 1) Jun 17 11:31:47.809691 dv-cinder-837166-3-iscsi devstack@n-api.service[110435]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 17 11:31:48.477367 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 17 11:31:48.488058 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 17 11:31:49.681477 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 11:31:49.681477 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: from cryptography.utils import int_from_bytes Jun 17 11:31:49.682238 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 11:31:49.682238 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: from cryptography.utils import int_from_bytes Jun 17 11:31:49.703548 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 11:31:49.703548 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: from cryptography.utils import int_from_bytes Jun 17 11:31:49.704154 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 11:31:49.704154 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: from cryptography.utils import int_from_bytes Jun 17 11:31:52.301767 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 11:31:52.302343 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 11:31:52.302690 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 11:31:52.302771 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 11:31:52.302846 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 11:31:52.302944 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 11:31:52.303047 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 11:31:52.303127 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 11:31:52.303199 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 11:31:52.303265 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 11:31:52.303537 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.303688 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.303842 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.304015 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.304702 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.304863 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.305030 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.305187 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.305500 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.305606 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.305813 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.305911 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.306132 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.306220 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.306452 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.306549 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.306777 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.306879 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.307041 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.307153 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.307355 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.307492 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.307704 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837166-3-iscsi {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.307817 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837166-3-iscsi {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.308019 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.308105 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.308324 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.308423 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.308630 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.308730 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.308945 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.309042 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.309245 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.309342 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.309564 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.309667 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.309868 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.309961 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.310359 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.310751 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.310990 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.311113 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.311222 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.311337 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.311492 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.311612 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.311737 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.311852 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.312040 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.312177 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.312346 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.312455 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.312664 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.312752 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.312969 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.313056 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.313289 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.313384 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.313592 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.313690 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.313995 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837166-3-iscsi {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.314108 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837166-3-iscsi {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.314307 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.314408 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.314645 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.314754 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.314938 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.315028 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.315357 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.315503 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.315693 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.315791 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.316019 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.316115 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.316349 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.316454 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.316682 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.316794 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.316995 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.317112 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.317322 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.317413 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.317637 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.317742 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.317953 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.318044 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.318272 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.318363 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.318570 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.318659 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.318880 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.318974 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.319185 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.319276 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.319523 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.319614 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.320380 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.320555 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.321148 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.321251 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.321320 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.321394 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.321506 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.321595 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.321704 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.321914 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.322022 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.322163 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.322340 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.322450 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.322596 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.322704 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.322849 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.322938 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.323170 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.323266 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.323516 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.323621 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.323830 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.323938 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.324134 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.324225 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.324445 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.324557 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.324745 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.324866 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.325046 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.325141 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.325352 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.325447 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.325656 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.325760 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.325960 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.326054 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.326274 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.326368 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.326588 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.326688 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.326920 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.327020 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.327208 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.327302 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.327554 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.327655 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.327959 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.328057 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.328214 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.328309 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.328520 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.328614 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.328858 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.328953 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.329179 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.329275 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.329486 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.329581 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.329804 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.329892 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.330120 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.330206 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.330425 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.330520 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.330728 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.330825 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.331030 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.331126 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.331348 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.331473 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.331705 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.331793 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.332012 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.332108 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.332242 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.332363 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.332542 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.332630 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.332888 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.332984 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.333208 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.333303 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.333512 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.333606 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.333818 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.333913 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.334124 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.334210 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.334423 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.334508 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.334724 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.334830 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.335282 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.335431 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.335850 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.335979 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.336172 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.336263 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.336486 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.336574 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.336804 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.336891 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.337117 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.337214 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.337419 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.337507 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.337725 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.337833 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.338040 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.338131 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.338358 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.338447 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.338696 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.338788 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.339010 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.339101 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.339319 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.339447 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.339652 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.339741 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.339971 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.340058 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.340274 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.340370 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.340578 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.340666 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.340898 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.340993 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.341202 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.341288 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.341502 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.341589 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.341816 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.341915 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.342120 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.342216 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.342422 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.342511 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.342736 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.342835 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.343034 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.343128 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.343338 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.343475 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.343677 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.343765 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.343981 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.344076 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.344284 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.344378 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.344582 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.344676 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.344899 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.344994 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.345184 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.345279 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.345483 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.345576 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.345782 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.345879 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.346083 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.346182 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.346379 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.346466 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.346692 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.346778 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.347007 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.347102 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.347312 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.347435 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.347644 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.347756 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.347949 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.348056 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.348261 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.348356 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:31:52.348594 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.348682 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.348920 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.349008 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.349285 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.349374 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.349603 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.349697 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.349938 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.350035 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.350276 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.350362 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.350612 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.350712 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.350927 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.351087 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.351311 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.351482 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.351751 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.351852 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.352072 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.352159 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.352389 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.352485 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.352698 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.352800 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.353016 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.353112 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.353333 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.353444 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.353657 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.353755 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.353973 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.354070 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.354288 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.354421 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.354601 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.354706 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.354910 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.355007 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.355227 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.355315 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.355580 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.355678 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.355936 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.356076 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.356247 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.356336 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.356587 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.356684 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.356931 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.357021 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.357243 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.357331 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.357566 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.357656 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.357887 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.357999 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.358198 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.358307 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.358504 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.358594 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.358812 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.358900 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.359135 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.359302 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.359489 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.359582 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.359801 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.359884 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.360119 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.360205 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.360427 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.360512 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.360737 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.360824 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.361047 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.361137 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.361357 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.361434 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.361680 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.361782 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.362000 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.362095 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.362315 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.362439 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.362628 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.362767 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.362940 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.363039 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.363255 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.363344 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.363588 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.363678 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.363899 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.363988 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.364207 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.364295 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.364512 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.364612 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.364813 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.364908 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.365114 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.365239 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.365423 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.365514 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.365726 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.365822 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.366045 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.366131 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.366371 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.366458 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.367280 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.367482 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.367659 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.367833 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.367973 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.368145 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.368293 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.368463 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.368608 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.368776 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.368921 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.369089 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.369228 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.369395 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.369543 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.369713 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.369856 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.370022 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.370161 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.370327 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.370490 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.370654 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.370799 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.370965 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.371107 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.371271 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.371453 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.371619 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.371768 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.371925 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.372077 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.372232 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.372392 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.372547 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.372693 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.372858 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.373028 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.373218 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.373340 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.373530 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.373651 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.373843 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.374022 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.374164 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.374341 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.374480 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.374657 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.374793 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.374993 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.375126 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.375326 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.375482 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.375658 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.375790 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.375988 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.376096 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.376316 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.376413 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.376634 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.376722 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.376942 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.377032 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.377255 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.377352 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.377560 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.377649 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.377864 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.377961 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.378168 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.378269 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.378477 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.378566 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.378778 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.378864 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.379078 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.379166 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.379406 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.379509 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.379694 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.379780 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.379996 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.380085 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.380314 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.380411 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.380623 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.380711 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.380926 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.381014 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.381226 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.381314 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.381526 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.381620 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.381862 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.381959 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.382167 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.382293 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.383074 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.383171 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.383452 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.383585 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.383778 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.383914 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.384105 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.384241 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.384420 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.384557 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.384760 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.384953 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.385074 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.385267 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.385388 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.385583 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.385701 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.385896 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.386012 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.386209 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.386333 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.386529 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.386644 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.386842 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.386963 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.387161 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.387262 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.387507 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.387610 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.387835 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.387936 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.388148 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.388244 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.388470 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.388558 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.388774 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.388876 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.389090 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.389178 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.389425 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.389513 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.389763 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.389931 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.390120 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.390269 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.390443 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.390588 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.390743 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.390905 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.391044 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.391180 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.391347 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.391608 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.391760 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.391916 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.392112 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.392271 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.392415 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.392568 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.392726 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.392869 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.393009 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.393154 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.393307 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.393520 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.393681 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.393824 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.393936 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.394019 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.394098 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.394177 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.394356 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.394446 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.394659 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.394753 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.394971 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.395070 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.395297 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.395407 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.395658 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.395759 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.395971 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.396080 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.396281 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.396369 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.396602 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.396689 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.396913 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.397011 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.397221 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.397309 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.397525 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.397611 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.397843 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.397950 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.398164 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.398279 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.398499 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.398576 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.398811 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.398908 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.399123 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.399210 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.399457 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.399551 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.399776 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.399866 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.400087 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.400175 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.400395 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.400490 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.400696 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.400784 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.401000 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.401098 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.401311 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.401398 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.401630 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.401731 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.401936 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.402024 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.402257 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.402352 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.402575 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.402663 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.402877 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.402962 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.403180 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.403267 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.403533 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.403674 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.403842 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.403991 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.404143 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.404239 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.404443 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.404530 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.404745 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.404832 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.405087 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.405187 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.405389 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.405476 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.405692 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.405778 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.406009 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.406105 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.406316 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.406429 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.406628 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.406723 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.406935 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.407024 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.407244 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.407354 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.407610 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.407712 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.407922 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.408020 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.408233 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.408321 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.408543 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.408631 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.408852 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.408942 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.409162 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.409258 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.409473 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.409564 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.409867 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.409968 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.410091 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.410193 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.410401 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.410507 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.410705 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.410793 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.411008 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.411103 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.411308 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.411437 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.411642 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.411732 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.411961 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.412224 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.412530 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.412638 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.412860 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.412950 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.413175 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.413263 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.413595 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.413782 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.413980 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.414097 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.414300 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.414490 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.414629 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.414825 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.414954 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.415178 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.415279 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.415521 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.415622 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.415815 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.415911 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.416127 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.416217 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.416436 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.416525 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.416798 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.416895 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.417059 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.417149 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.417359 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.417452 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.417662 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.417759 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.417969 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.418066 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.418272 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.418360 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.418597 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.418699 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.418916 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.419017 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.419220 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.419307 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.419562 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.419663 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.419867 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.419954 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.420174 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.420263 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.420477 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.420574 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.420798 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.420886 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.421104 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.421191 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.421406 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.421494 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.421705 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.421791 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.422008 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.422104 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.422346 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.422442 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.422650 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.422745 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.422987 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.423075 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.423314 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.423433 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.423681 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.423770 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.423986 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.424083 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.424290 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.424379 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.424649 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.424745 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.424957 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.425059 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.425263 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.425352 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.425564 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.425651 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.425871 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.425975 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.426177 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.426264 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.426477 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.426565 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.426784 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.426889 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.427091 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.427185 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.427416 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.427521 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.427728 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.427828 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.428028 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.428115 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.428334 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.428422 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.428632 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.428720 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.428944 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.429033 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.429796 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.429935 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.430141 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.430249 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.430470 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.430611 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.430785 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.430929 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.431095 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.431307 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.431410 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.431652 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.431741 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.431965 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.432066 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.432273 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.432369 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.432592 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.432681 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.432894 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.432982 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.433195 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.433281 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.433499 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.433587 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.433806 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.433903 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.434110 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.434199 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.434410 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.434507 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.434730 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.434820 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.435039 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.435118 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.435342 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.435518 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.435669 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.435766 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.435978 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.436066 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.436279 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.436378 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.436582 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.436677 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.436890 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.436978 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.437207 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.437306 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.437511 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.437608 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.437810 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.437904 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.438116 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.438213 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.438415 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.438502 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.438718 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.438804 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.439016 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.439118 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.439318 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.439436 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.439644 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.439731 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.439943 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.440032 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.440241 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.440335 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.440542 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.440630 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.440845 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.440935 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.441157 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.441253 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.441462 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.441548 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.441762 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.441852 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.442065 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.442153 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.442363 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.442459 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.442702 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.442793 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.443003 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.443092 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.443351 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.443543 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.443679 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.443767 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.443992 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.444081 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.444301 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.444401 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.444608 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.444714 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.445003 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.445091 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.445377 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.445501 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.445662 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.445754 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.445977 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.446065 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.446288 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.446388 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.446632 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.446729 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.446943 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.447032 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.447292 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.447448 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.447636 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.447726 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.447952 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.448039 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.448278 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.448377 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.448604 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.448701 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.448931 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.449019 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.449235 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.449325 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.449542 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.449629 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.449850 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.449937 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.450158 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.450247 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.450466 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.450553 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.450772 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.450859 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.451079 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.451169 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.451403 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.451496 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.451716 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.451814 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.452029 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.452117 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.452339 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.452425 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.452645 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.452745 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.452950 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.453037 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.453295 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.453389 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.453603 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.453700 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.453907 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.453994 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.454230 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.454366 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.454537 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.454636 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.454838 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.454927 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.455143 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.455229 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.455477 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.455567 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.455784 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.455873 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.456085 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.456224 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.456520 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.456617 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.456833 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.456929 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.457138 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.457225 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.457443 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.457531 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.457754 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.457842 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.458062 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.458150 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.458377 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.458466 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.458691 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.458780 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.459060 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.459157 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.459466 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.459558 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.459782 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.459889 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.460889 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.461000 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.461224 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.461351 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.461575 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.461653 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.461894 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.461994 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.462227 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.462315 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.462537 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.462626 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.462846 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.462942 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.463151 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.463240 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.463482 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.463573 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.463805 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.463895 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.464110 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.464198 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.464432 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.464542 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.464899 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.464986 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.465209 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.465297 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.465514 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.465645 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.465931 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.466033 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.466242 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.466377 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.466553 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.466651 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.466876 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.466966 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.467198 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.467289 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.467531 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.467634 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.467839 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.467937 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.468153 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.468251 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.468465 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.468554 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.468788 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.468886 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.469112 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.469201 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.469448 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.469580 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.469758 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.469901 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.470107 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.470197 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.470452 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.470542 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.470772 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.470869 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.471099 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.471188 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.471461 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.471579 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.471859 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.471956 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.472174 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.472267 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.472485 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.472576 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.472808 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.472953 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.473114 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.473210 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.473422 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.473518 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.473722 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.473812 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.474027 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.474114 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.474328 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.474416 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.474632 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.474730 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.474945 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.475034 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.475264 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.475413 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.475627 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.475751 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.475936 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.476120 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.476304 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.476480 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.476751 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.476839 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.477075 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.477162 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.477380 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.477476 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.477688 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.477776 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.478010 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.478106 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.478324 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.478428 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.478647 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.478745 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.478956 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.479047 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.479258 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.479354 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.479603 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.479692 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.479910 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.479997 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.480213 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.480303 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.480513 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.480601 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.480817 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.480906 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.481151 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.481247 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.481477 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.481566 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.481847 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.482003 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.482175 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.482267 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.482488 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.482577 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.482801 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.482903 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.483134 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.483224 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.483491 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.483595 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.483809 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.483908 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.484127 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.484216 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.484430 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.484518 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.484737 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.484876 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.485036 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.485125 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.485344 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.485442 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.485650 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.485749 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.485955 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.486043 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.486255 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.486343 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.486557 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.486646 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.486854 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.486941 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.487155 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.487245 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.487478 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.487571 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.487830 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.487919 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.488144 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.488233 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.488454 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.488552 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.488762 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.488849 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.489066 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.489155 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.489369 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.489465 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.489670 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.489758 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.490010 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.490107 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.490314 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.490402 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.490646 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.490734 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.490963 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.491065 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.491283 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.491394 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.492171 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.492268 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.492485 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.492648 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.492811 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.493288 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.493426 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.493607 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.493752 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.494015 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.494141 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.494297 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.494431 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.494615 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.494759 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.494929 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.495069 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.495242 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.495434 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.495561 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.495712 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.495869 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.495994 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.496175 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.496330 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.496496 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.496661 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.497064 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.497213 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.497398 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.497543 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.497716 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.497877 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.498021 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.498173 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.498318 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.498460 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.498617 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.498759 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.498956 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.499104 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.499273 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.499385 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.499620 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.499711 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.499942 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.500093 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.500255 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.500395 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.500651 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.500796 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.500939 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.501082 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.501224 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.501387 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.501534 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.501679 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.501823 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.501963 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.502111 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.502289 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.502436 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.502593 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.502742 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.502892 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.503039 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.503208 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.503354 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.503601 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.503742 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.503884 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.504045 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.504173 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.504328 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.504485 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.504628 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.504781 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.504941 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.505083 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.505280 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.505425 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.505564 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.505717 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.505859 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.506010 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.506151 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.506304 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.506445 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.506598 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.506750 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.506889 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.507093 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.508089 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.508089 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.508380 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.508524 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.508667 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.508815 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.508956 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.509119 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.509264 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.509407 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.509520 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.509605 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.509685 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.510082 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.510182 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.510420 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.510546 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.510874 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.510980 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.511109 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.511206 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.511464 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.511559 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.511784 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.511894 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.512105 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.512195 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.512433 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.512522 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.512739 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.512836 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.513045 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.513143 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.513354 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.513451 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.513667 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.513765 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.513974 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.514085 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.514290 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.514380 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.514599 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.514696 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.514901 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.514989 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.515221 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.515392 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.515557 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.515648 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.516090 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.516177 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.516438 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.516539 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.516754 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.516845 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.517079 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.517170 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.517402 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.517497 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.517719 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.517809 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.518051 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.518178 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.518378 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.518476 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.518682 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.518771 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.518986 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.519074 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.519302 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.519435 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.519641 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.519730 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.519946 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.520034 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.520249 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.520351 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.520561 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.520659 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.520870 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.520967 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.521171 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.521315 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.521481 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.521578 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.521821 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.521910 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.522169 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.522267 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.522479 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.522569 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.522786 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.522913 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.523137 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.523227 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.523475 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.523559 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.523793 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.523881 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.524101 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.524193 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.524410 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.524498 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.524715 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.524827 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.525025 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.525116 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.525329 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.525418 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.525636 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.525739 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.525941 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.526031 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.526249 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.526353 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.526553 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.526641 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.526859 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.526954 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.527208 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.527306 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.527576 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.527676 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.527888 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.527994 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.528193 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.528339 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.528510 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.528609 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.528819 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.528907 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.529137 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.529225 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.529449 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.529552 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.529758 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.529846 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.530103 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.530191 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.530420 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.530512 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.530949 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.531038 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.531282 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.531392 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.531631 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.531721 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.531964 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.532051 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.532294 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.532385 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.532601 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.532692 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.532908 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.533006 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.533213 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.533304 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.533561 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.533651 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.533886 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.533978 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.534201 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.534300 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.534518 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.534607 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.534846 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.534934 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.535156 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.535259 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.535492 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.535586 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.535803 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.535893 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.536114 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.536219 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.536421 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.536511 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.536729 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.536819 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.537037 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.537128 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.537345 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.537436 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.537653 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.537742 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.537958 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.538039 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.538296 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.538449 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.538811 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.538885 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.539082 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.539163 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.539314 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.539435 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.539663 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.539763 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.539977 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.540067 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.540289 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.540387 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.540596 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.540699 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.540903 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.540993 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.541218 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.541309 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.541547 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.541646 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.541865 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.541964 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.542163 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.542250 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.542587 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.542677 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.542899 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.542986 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.543213 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.543309 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.543561 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.543663 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.543872 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.543969 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.544194 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.544290 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.544513 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.544611 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.544860 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.544959 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.545173 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.545272 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.545506 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.545602 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.545838 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.545929 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.546180 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.546280 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.546512 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.546601 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.546839 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.546930 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.547146 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.547243 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.547473 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.547566 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.547779 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.547878 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.548087 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.548184 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.548404 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.548549 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.548710 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.548798 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.549013 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.549103 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.549338 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.549434 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.549665 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.549763 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.549983 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.550073 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.550299 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.550388 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.550629 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.550727 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.550936 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.551034 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.551242 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.551331 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.551570 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.551659 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.551919 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.552016 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.552174 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.552264 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.552473 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.552570 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.552798 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.552887 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.553101 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.553189 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.553410 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.553517 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.553714 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.553810 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.554013 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.554624 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.554852 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.555021 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.555202 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.555428 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.555531 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.555666 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.555806 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.556003 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.556136 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.556374 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.556555 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.556697 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.556882 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.557023 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.557196 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.557340 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.557518 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.557664 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.557827 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.557977 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.558148 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.558300 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.558470 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.558627 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.558784 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.558943 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.559091 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.559254 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.559445 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.559623 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.559758 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.559938 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.560071 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.560252 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.560383 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.560550 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.560692 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.560865 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.561001 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.561175 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.561309 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.561486 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.561692 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.561833 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.562018 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.562162 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.562322 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.562469 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.562647 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.562797 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.562963 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.563116 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.563282 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.563459 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.563696 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.563798 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.564009 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.564147 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.564339 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.564430 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.564649 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.564739 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.564958 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.565047 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.565273 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.565371 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.565603 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.565697 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.565926 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.566020 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.566229 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.566321 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.566596 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.566733 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.566923 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.567023 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.567248 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.567345 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.567609 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.567702 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.567937 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.568035 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.568266 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.568354 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.568608 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.568746 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.568921 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.569020 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.569263 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.569352 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.569593 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.569680 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.570525 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.570692 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.570810 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.570898 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.571116 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.571206 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:31:52.571358 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 11:31:52.571480 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 11:31:52.634884 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO dbcounter [None req-c39c97a3-8c46-4bfe-bf7c-bbf4464113b1 None None] Registered counter for database nova_api Jun 17 11:31:52.635019 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO dbcounter [None req-fcfb26f5-bcf3-4442-8de7-2368d5fc8a61 None None] Registered counter for database nova_api Jun 17 11:31:52.656466 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG oslo_db.sqlalchemy.engines [None req-fcfb26f5-bcf3-4442-8de7-2368d5fc8a61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110436) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 11:31:52.659872 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG oslo_db.sqlalchemy.engines [None req-c39c97a3-8c46-4bfe-bf7c-bbf4464113b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110437) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 11:31:52.663183 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writer thread running {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 11:31:52.667748 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG dbcounter [-] [110437] Writer thread running {{(pid=110437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 11:31:52.721828 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.context [None req-fcfb26f5-bcf3-4442-8de7-2368d5fc8a61 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c323a48d-876b-4d2b-a1cd-4651eaf7de7b(cell1) {{(pid=110436) load_cells /opt/stack/nova/nova/context.py:464}} Jun 17 11:31:52.725360 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.context [None req-c39c97a3-8c46-4bfe-bf7c-bbf4464113b1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c323a48d-876b-4d2b-a1cd-4651eaf7de7b(cell1) {{(pid=110437) load_cells /opt/stack/nova/nova/context.py:464}} Jun 17 11:31:52.726561 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-fcfb26f5-bcf3-4442-8de7-2368d5fc8a61 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:31:52.728395 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-fcfb26f5-bcf3-4442-8de7-2368d5fc8a61 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:31:52.729194 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-fcfb26f5-bcf3-4442-8de7-2368d5fc8a61 None None] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:31:52.730364 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG oslo_concurrency.lockutils [None req-c39c97a3-8c46-4bfe-bf7c-bbf4464113b1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:31:52.731396 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-fcfb26f5-bcf3-4442-8de7-2368d5fc8a61 None None] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:31:52.731975 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG oslo_concurrency.lockutils [None req-c39c97a3-8c46-4bfe-bf7c-bbf4464113b1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:31:52.732762 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG oslo_concurrency.lockutils [None req-c39c97a3-8c46-4bfe-bf7c-bbf4464113b1 None None] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:31:52.733466 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO dbcounter [None req-fcfb26f5-bcf3-4442-8de7-2368d5fc8a61 None None] Registered counter for database nova_cell0 Jun 17 11:31:52.734877 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG oslo_concurrency.lockutils [None req-c39c97a3-8c46-4bfe-bf7c-bbf4464113b1 None None] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:31:52.737010 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO dbcounter [None req-c39c97a3-8c46-4bfe-bf7c-bbf4464113b1 None None] Registered counter for database nova_cell0 Jun 17 11:31:52.740543 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO dbcounter [None req-fcfb26f5-bcf3-4442-8de7-2368d5fc8a61 None None] Registered counter for database nova_cell1 Jun 17 11:31:52.740942 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO dbcounter [None req-c39c97a3-8c46-4bfe-bf7c-bbf4464113b1 None None] Registered counter for database nova_cell1 Jun 17 11:31:52.745971 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG oslo_db.sqlalchemy.engines [None req-fcfb26f5-bcf3-4442-8de7-2368d5fc8a61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110436) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 11:31:52.747746 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG oslo_db.sqlalchemy.engines [None req-fcfb26f5-bcf3-4442-8de7-2368d5fc8a61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110436) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 11:31:52.749165 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG oslo_db.sqlalchemy.engines [None req-c39c97a3-8c46-4bfe-bf7c-bbf4464113b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110437) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 11:31:52.751400 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG oslo_db.sqlalchemy.engines [None req-c39c97a3-8c46-4bfe-bf7c-bbf4464113b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110437) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 11:31:52.751657 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writer thread running {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 11:31:52.756826 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG dbcounter [-] [110437] Writer thread running {{(pid=110437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 11:31:52.759031 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG dbcounter [-] [110437] Writer thread running {{(pid=110437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 11:31:52.899417 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writer thread running {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 11:31:52.906706 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO dbcounter [None req-c39c97a3-8c46-4bfe-bf7c-bbf4464113b1 None None] Registered counter for database nova_cell0 Jun 17 11:31:52.908765 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO dbcounter [None req-fcfb26f5-bcf3-4442-8de7-2368d5fc8a61 None None] Registered counter for database nova_cell0 Jun 17 11:31:52.916269 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG oslo_db.sqlalchemy.engines [None req-c39c97a3-8c46-4bfe-bf7c-bbf4464113b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110437) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 11:31:52.919956 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG oslo_db.sqlalchemy.engines [None req-fcfb26f5-bcf3-4442-8de7-2368d5fc8a61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110436) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 11:31:52.920742 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG dbcounter [-] [110437] Writer thread running {{(pid=110437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 11:31:52.924331 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writer thread running {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 11:31:53.365776 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: WARNING keystonemiddleware.auth_token [None req-c39c97a3-8c46-4bfe-bf7c-bbf4464113b1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 11:31:53.373217 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: WARNING keystonemiddleware.auth_token [None req-c39c97a3-8c46-4bfe-bf7c-bbf4464113b1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 11:31:53.420618 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: WARNING keystonemiddleware.auth_token [None req-fcfb26f5-bcf3-4442-8de7-2368d5fc8a61 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 11:31:53.427888 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: WARNING keystonemiddleware.auth_token [None req-fcfb26f5-bcf3-4442-8de7-2368d5fc8a61 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 11:31:53.719576 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: WARNING keystonemiddleware.auth_token [None req-c39c97a3-8c46-4bfe-bf7c-bbf4464113b1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 11:31:53.725814 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: WARNING keystonemiddleware.auth_token [None req-c39c97a3-8c46-4bfe-bf7c-bbf4464113b1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 11:31:53.731733 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f8201c19c0 pid: 110437 (default app) Jun 17 11:31:53.733792 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-c39c97a3-8c46-4bfe-bf7c-bbf4464113b1 None None] Calling method '>' {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:31:53.734982 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-c39c97a3-8c46-4bfe-bf7c-bbf4464113b1 None None] 10.222.0.45 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001736 Jun 17 11:31:53.735414 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 788 bytes} [Fri Jun 17 11:31:53 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:31:53.781816 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: WARNING keystonemiddleware.auth_token [None req-fcfb26f5-bcf3-4442-8de7-2368d5fc8a61 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 11:31:53.787867 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: WARNING keystonemiddleware.auth_token [None req-fcfb26f5-bcf3-4442-8de7-2368d5fc8a61 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 11:31:53.794343 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f8201c19c0 pid: 110436 (default app) Jun 17 11:33:16.406808 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-c39c97a3-8c46-4bfe-bf7c-bbf4464113b1 None None] Calling method '>' {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:33:16.409086 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-c39c97a3-8c46-4bfe-bf7c-bbf4464113b1 None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002743 Jun 17 11:33:16.415249 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 2/2] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jun 17 11:33:16 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:33:16.422376 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writing DB stats nova_api:SELECT=3 {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:33:16.423839 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writing DB stats nova_cell0:SELECT=3 {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:33:16.424686 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writing DB stats nova_cell1:SELECT=3 {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:33:16.426296 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:33:16.892991 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-6625c006-5b6e-4c8c-ad4f-1565f95d26b8 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:33:16.923950 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-6625c006-5b6e-4c8c-ad4f-1565f95d26b8 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.506659 Jun 17 11:33:16.925916 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 1/3] 10.222.0.45 () {60 vars in 1291 bytes} [Fri Jun 17 11:33:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:33:19.220786 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-c39c97a3-8c46-4bfe-bf7c-bbf4464113b1 None None] Calling method '>' {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:33:19.223472 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-c39c97a3-8c46-4bfe-bf7c-bbf4464113b1 None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002985 Jun 17 11:33:19.223885 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 3/4] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jun 17 11:33:19 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:33:19.317166 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-c290f358-a090-4727-8c44-959990935d6b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "cirros256", "swap": 0, "vcpus": 1, "id": "c1", "os-flavor-access:is_public": true}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:33:19.333995 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 11:33:19.333995 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: warnings.warn(msg) Jun 17 11:33:19.514794 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-c290f358-a090-4727-8c44-959990935d6b admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.284170 Jun 17 11:33:19.519554 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 2/5] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Jun 17 11:33:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 11:33:19.529061 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG dbcounter [-] [110437] Writing DB stats nova_api:SELECT=3 {{(pid=110437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:33:19.529778 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG dbcounter [-] [110437] Writing DB stats nova_cell1:SELECT=3 {{(pid=110437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:33:19.530492 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG dbcounter [-] [110437] Writing DB stats nova_cell0:SELECT=3 {{(pid=110437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:33:19.531462 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG dbcounter [-] [110437] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:33:19.748684 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-8dac8163-14fd-48ab-a434-a2c9b3360ad9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:33:19.751105 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 11:33:19.751105 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: warnings.warn(msg) Jun 17 11:33:19.945127 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-8dac8163-14fd-48ab-a434-a2c9b3360ad9 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.421705 Jun 17 11:33:19.946372 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 4/6] 10.222.0.45 () {64 vars in 1335 bytes} [Fri Jun 17 11:33:19 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:33:22.245953 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-c290f358-a090-4727-8c44-959990935d6b admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:33:22.246865 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-c290f358-a090-4727-8c44-959990935d6b admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jun 17 11:33:22.247480 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 3/7] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jun 17 11:33:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:33:22.357882 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-35e36f2b-b620-4338-b646-1fa8181c9b63 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds512M", "id": "d1", "disk": 5, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:33:22.376463 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 11:33:22.376463 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: warnings.warn(msg) Jun 17 11:33:22.534498 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-35e36f2b-b620-4338-b646-1fa8181c9b63 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.279968 Jun 17 11:33:22.535484 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 5/8] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Jun 17 11:33:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 11:33:22.551523 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-8a0672f9-0698-4040-9903-e702e5872945 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:33:22.559498 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 11:33:22.559498 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: warnings.warn(msg) Jun 17 11:33:22.703841 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-8a0672f9-0698-4040-9903-e702e5872945 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.157571 Jun 17 11:33:22.704722 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 4/9] 10.222.0.45 () {64 vars in 1335 bytes} [Fri Jun 17 11:33:22 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:33:24.920076 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-35e36f2b-b620-4338-b646-1fa8181c9b63 admin admin] Calling method '>' {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:33:24.921438 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-35e36f2b-b620-4338-b646-1fa8181c9b63 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001592 Jun 17 11:33:24.921775 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 6/10] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jun 17 11:33:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:33:24.986569 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-4f12dd80-0653-458c-9e21-81a619b6bbab admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "vcpus": 1, "rxtx_factor": 1.0, "id": "d2", "name": "ds1G"}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:33:25.077462 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-4f12dd80-0653-458c-9e21-81a619b6bbab admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.148558 Jun 17 11:33:25.078199 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 5/11] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Jun 17 11:33:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 11:33:25.091653 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-0f2011fb-6d93-4241-a41e-9ce7ce0bff7f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:33:25.195639 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-0f2011fb-6d93-4241-a41e-9ce7ce0bff7f admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107121 Jun 17 11:33:25.196612 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 7/12] 10.222.0.45 () {64 vars in 1335 bytes} [Fri Jun 17 11:33:25 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:33:27.423714 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-4f12dd80-0653-458c-9e21-81a619b6bbab admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:33:27.424831 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-4f12dd80-0653-458c-9e21-81a619b6bbab admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Jun 17 11:33:27.424831 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 6/13] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jun 17 11:33:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:33:27.489265 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-0b89bf47-dc9d-4715-8095-4639e42b7689 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "name": "ds2G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "id": "d3", "os-flavor-access:is_public": true}} {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:33:27.590575 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-0b89bf47-dc9d-4715-8095-4639e42b7689 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.158807 Jun 17 11:33:27.591141 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 8/14] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Jun 17 11:33:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 11:33:27.603732 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-6d46da65-f593-4dd7-a42d-9312197fd7f5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:33:27.687010 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-6d46da65-f593-4dd7-a42d-9312197fd7f5 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087191 Jun 17 11:33:27.687784 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 7/15] 10.222.0.45 () {64 vars in 1335 bytes} [Fri Jun 17 11:33:27 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:33:29.947599 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-0b89bf47-dc9d-4715-8095-4639e42b7689 admin admin] Calling method '>' {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:33:29.948611 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-0b89bf47-dc9d-4715-8095-4639e42b7689 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Jun 17 11:33:29.949015 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 9/16] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jun 17 11:33:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:33:30.016501 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-a64a0eda-e50d-4f89-baca-081e4fea723d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "id": "d4", "disk": 20, "name": "ds4G", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:33:30.140223 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-a64a0eda-e50d-4f89-baca-081e4fea723d admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.184520 Jun 17 11:33:30.140982 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 8/17] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Jun 17 11:33:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 11:33:30.153662 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-a6bbf30d-d576-461d-9a22-ce9f049adf40 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:33:30.274778 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-a6bbf30d-d576-461d-9a22-ce9f049adf40 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.124733 Jun 17 11:33:30.275573 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 10/18] 10.222.0.45 () {64 vars in 1335 bytes} [Fri Jun 17 11:33:30 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:33:32.499692 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-a64a0eda-e50d-4f89-baca-081e4fea723d admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:33:32.500962 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-a64a0eda-e50d-4f89-baca-081e4fea723d admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001732 Jun 17 11:33:32.501714 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 9/19] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jun 17 11:33:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:33:32.576494 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-952cb150-8c54-46d7-987f-d3e183bfcc51 admin admin] Calling method '>' {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:33:32.604049 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-952cb150-8c54-46d7-987f-d3e183bfcc51 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.095213 Jun 17 11:33:32.604940 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 11/20] 10.222.0.45 () {60 vars in 1291 bytes} [Fri Jun 17 11:33:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:33:34.878085 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-a64a0eda-e50d-4f89-baca-081e4fea723d admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:33:34.879528 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-a64a0eda-e50d-4f89-baca-081e4fea723d admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002282 Jun 17 11:33:34.880121 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 10/21] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jun 17 11:33:34 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:33:34.960155 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-d25f1d98-33cc-4bb8-9712-8ef498f67916 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "id": "1", "ram": 512, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny"}} {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:33:35.046284 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-d25f1d98-33cc-4bb8-9712-8ef498f67916 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.159868 Jun 17 11:33:35.046908 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 12/22] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Jun 17 11:33:34 2022] POST /compute/v2.1/flavors => generated 402 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 11:33:35.062567 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-4843fe91-629d-4398-b83f-e8856632dfbf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:33:35.161569 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-4843fe91-629d-4398-b83f-e8856632dfbf admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103714 Jun 17 11:33:35.162516 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 11/23] 10.222.0.45 () {64 vars in 1332 bytes} [Fri Jun 17 11:33:35 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:33:38.282050 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-d25f1d98-33cc-4bb8-9712-8ef498f67916 admin admin] Calling method '>' {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:33:38.284445 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-d25f1d98-33cc-4bb8-9712-8ef498f67916 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002373 Jun 17 11:33:38.285463 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 13/24] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jun 17 11:33:38 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:33:38.376205 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-33466e0c-e1a7-444e-97cd-a24f1ffae7f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.small", "swap": 0, "vcpus": 1}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:33:38.453800 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-33466e0c-e1a7-444e-97cd-a24f1ffae7f0 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.159547 Jun 17 11:33:38.454649 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 12/25] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Jun 17 11:33:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 11:33:38.473999 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-18aca140-b856-45a5-85c0-819b27536635 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:33:38.577265 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-18aca140-b856-45a5-85c0-819b27536635 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109519 Jun 17 11:33:38.577863 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 14/26] 10.222.0.45 () {64 vars in 1332 bytes} [Fri Jun 17 11:33:38 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:33:41.342364 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-33466e0c-e1a7-444e-97cd-a24f1ffae7f0 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:33:41.344170 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-33466e0c-e1a7-444e-97cd-a24f1ffae7f0 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002486 Jun 17 11:33:41.344891 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 13/27] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jun 17 11:33:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:33:41.426908 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-760057e5-d2f1-4c8d-91b5-d1af9c9cf68b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 4096, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "name": "m1.medium", "vcpus": 2}} {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:33:41.568348 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-760057e5-d2f1-4c8d-91b5-d1af9c9cf68b admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.212624 Jun 17 11:33:41.568922 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 15/28] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Jun 17 11:33:41 2022] POST /compute/v2.1/flavors => generated 406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 11:33:41.591755 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-9f40ae8a-f98c-408c-920e-1fc473e408d2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:33:41.708041 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-9f40ae8a-f98c-408c-920e-1fc473e408d2 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.123333 Jun 17 11:33:41.709050 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 14/29] 10.222.0.45 () {64 vars in 1332 bytes} [Fri Jun 17 11:33:41 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:33:44.118569 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-760057e5-d2f1-4c8d-91b5-d1af9c9cf68b admin admin] Calling method '>' {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:33:44.119597 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-760057e5-d2f1-4c8d-91b5-d1af9c9cf68b admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jun 17 11:33:44.120001 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 16/30] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jun 17 11:33:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:33:44.237379 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-ef3b2303-5928-4d6c-ac62-9af8d4243efc admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "4", "name": "m1.large", "disk": 80, "rxtx_factor": 1.0, "swap": 0}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:33:44.365140 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-ef3b2303-5928-4d6c-ac62-9af8d4243efc admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.238409 Jun 17 11:33:44.365956 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 15/31] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Jun 17 11:33:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 11:33:44.383175 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-f36f79f0-c49c-4245-9874-299f83cc307c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:33:44.537093 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-f36f79f0-c49c-4245-9874-299f83cc307c admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.157545 Jun 17 11:33:44.537851 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 17/32] 10.222.0.45 () {64 vars in 1332 bytes} [Fri Jun 17 11:33:44 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:33:46.927624 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-ef3b2303-5928-4d6c-ac62-9af8d4243efc admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:33:46.929402 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-ef3b2303-5928-4d6c-ac62-9af8d4243efc admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003627 Jun 17 11:33:46.930123 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 16/33] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jun 17 11:33:46 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:33:47.026890 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-7789103e-4940-412c-8b97-5dd8b1f9e534 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "ram": 16384, "os-flavor-access:is_public": true, "disk": 160, "rxtx_factor": 1.0, "id": "5", "vcpus": 8}} {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:33:47.103598 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-7789103e-4940-412c-8b97-5dd8b1f9e534 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.166733 Jun 17 11:33:47.104494 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 18/34] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Jun 17 11:33:46 2022] POST /compute/v2.1/flavors => generated 408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 11:33:47.124253 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-f75916a0-e5ab-48b8-b797-45274e8b4f90 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:33:47.131402 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:33:47.268922 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-f75916a0-e5ab-48b8-b797-45274e8b4f90 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.150917 Jun 17 11:33:47.270125 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 17/35] 10.222.0.45 () {64 vars in 1332 bytes} [Fri Jun 17 11:33:47 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:34:12.693511 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-7789103e-4940-412c-8b97-5dd8b1f9e534 admin admin] Calling method '>' {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:34:12.694571 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-7789103e-4940-412c-8b97-5dd8b1f9e534 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 17 11:34:12.694974 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 19/36] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jun 17 11:34:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:34:12.755956 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-903ef23e-61f7-46e5-a00c-0586f2e2e1a3 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:34:12.773364 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-903ef23e-61f7-46e5-a00c-0586f2e2e1a3 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.072198 Jun 17 11:34:12.773903 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 18/37] 10.222.0.45 () {60 vars in 1291 bytes} [Fri Jun 17 11:34:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:34:13.808050 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-7789103e-4940-412c-8b97-5dd8b1f9e534 admin admin] Calling method '>' {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:34:13.809091 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-7789103e-4940-412c-8b97-5dd8b1f9e534 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jun 17 11:34:13.809493 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 20/38] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Jun 17 11:34:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:34:14.007640 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-23ce0278-50d3-49e6-bec9-6922184e52bc admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:34:14.013300 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.wsgi [None req-23ce0278-50d3-49e6-bec9-6922184e52bc admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 17 11:34:14.017188 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-23ce0278-50d3-49e6-bec9-6922184e52bc admin admin] Request method failure captured: Jun 17 11:34:14.017188 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 17 11:34:14.017188 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: Accept: application/json Jun 17 11:34:14.017188 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: Accept-Encoding: gzip, deflate Jun 17 11:34:14.017188 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: Connection: keep-alive Jun 17 11:34:14.017188 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: Content-Length: 0 Jun 17 11:34:14.017188 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: Host: 10.222.0.45 Jun 17 11:34:14.017188 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: Openstack-Api-Version: compute 2.90 Jun 17 11:34:14.017188 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: Openstack-System-Scope: None Jun 17 11:34:14.017188 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: User-Agent: python-novaclient Jun 17 11:34:14.017188 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Auth-Token: gAAAAABirGa1in8urvf4ux7ncthta36wmdTEH9XyTFcrDtREP1FzVfLSv7oUPETQa8aKZ67yFVhupQSV7eoGMgnbJ9Qi-Yc29i-PYY10g1vd1HxJiOz1ZPyIgnJ9rB4oU2lIoHjD20q_F6immiONKkTWxIwiXe2tINEsSbEvWJkNS91nvRlertI Jun 17 11:34:14.017188 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Domain-Id: None Jun 17 11:34:14.017188 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Domain-Name: None Jun 17 11:34:14.017188 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Identity-Status: Confirmed Jun 17 11:34:14.017188 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Is-Admin-Project: True Jun 17 11:34:14.017188 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 11:34:14.017188 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Project-Domain-Id: default Jun 17 11:34:14.017188 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Project-Domain-Name: Default Jun 17 11:34:14.017188 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Project-Id: da8f91d479d0446f9019ff5f3ebd9584 Jun 17 11:34:14.017188 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Project-Name: admin Jun 17 11:34:14.017188 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Role: member,reader,admin Jun 17 11:34:14.017188 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Roles: member,reader,admin Jun 17 11:34:14.018974 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/da8f91d479d0446f9019ff5f3ebd9584"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_da8f91d479d0446f9019ff5f3ebd9584", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/da8f91d479d0446f9019ff5f3ebd9584"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/da8f91d479d0446f9019ff5f3ebd9584"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:34:14.018974 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Tenant: admin Jun 17 11:34:14.018974 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Tenant-Id: da8f91d479d0446f9019ff5f3ebd9584 Jun 17 11:34:14.018974 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Tenant-Name: admin Jun 17 11:34:14.018974 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-User: admin Jun 17 11:34:14.018974 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-User-Domain-Id: default Jun 17 11:34:14.018974 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-User-Domain-Name: Default Jun 17 11:34:14.018974 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-User-Id: d95b918a589c451e9aa78a47b3b6c6aa Jun 17 11:34:14.018974 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-User-Name: admin Jun 17 11:34:14.018974 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: method: > Jun 17 11:34:14.018974 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: exception: Flavor 42 could not be found. Jun 17 11:34:14.018974 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: action_args: {'id': '42'} Jun 17 11:34:14.018974 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:34:14.018974 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:34:14.019903 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 11:34:14.019903 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 11:34:14.019903 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 11:34:14.019903 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 11:34:14.019903 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 11:34:14.019903 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 11:34:14.019903 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 11:34:14.019903 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 11:34:14.019903 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 11:34:14.019903 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:34:14.019903 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 11:34:14.019903 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 11:34:14.019903 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 17 11:34:14.019903 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Jun 17 11:34:14.019903 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:34:14.019903 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Jun 17 11:34:14.019903 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:34:14.019903 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:34:14.019903 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:34:14.021220 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:34:14.021220 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:34:14.021220 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:34:14.021220 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:34:14.021220 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 11:34:14.021220 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:34:14.021220 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 17 11:34:14.021220 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Jun 17 11:34:14.021220 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:34:14.021220 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Jun 17 11:34:14.021220 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:34:14.021220 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:34:14.021220 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:34:14.021220 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:34:14.021220 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:34:14.021220 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 17 11:34:14.021220 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Jun 17 11:34:14.021220 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-23ce0278-50d3-49e6-bec9-6922184e52bc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:34:14.022310 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-23ce0278-50d3-49e6-bec9-6922184e52bc admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.068914 Jun 17 11:34:14.022310 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 19/39] 10.222.0.45 () {60 vars in 1190 bytes} [Fri Jun 17 11:34:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 11:34:14.028399 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-4f72cad4-adaf-4632-b79a-d949438f809c admin admin] Calling method '>' {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:34:14.031470 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG dbcounter [-] [110437] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:34:14.051190 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-4f72cad4-adaf-4632-b79a-d949438f809c admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026250 Jun 17 11:34:14.051787 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 21/40] 10.222.0.45 () {60 vars in 1210 bytes} [Fri Jun 17 11:34:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:34:14.061897 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-e6d76df4-01dc-4a1d-ad9f-ed8a97e6cc32 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:34:14.084783 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-e6d76df4-01dc-4a1d-ad9f-ed8a97e6cc32 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026262 Jun 17 11:34:14.085169 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 20/41] 10.222.0.45 () {60 vars in 1210 bytes} [Fri Jun 17 11:34:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:34:14.094915 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-a34d454d-5ea9-4eff-a66c-174fc6793b7a admin admin] Calling method '>' {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:34:14.101294 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.wsgi [None req-a34d454d-5ea9-4eff-a66c-174fc6793b7a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 17 11:34:14.104638 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-a34d454d-5ea9-4eff-a66c-174fc6793b7a admin admin] Request method failure captured: Jun 17 11:34:14.104638 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 17 11:34:14.104638 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: Accept: application/json Jun 17 11:34:14.104638 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: Accept-Encoding: gzip, deflate Jun 17 11:34:14.104638 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: Connection: keep-alive Jun 17 11:34:14.104638 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: Content-Length: 0 Jun 17 11:34:14.104638 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: Host: 10.222.0.45 Jun 17 11:34:14.104638 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: Openstack-Api-Version: compute 2.90 Jun 17 11:34:14.104638 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: Openstack-System-Scope: None Jun 17 11:34:14.104638 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: User-Agent: python-novaclient Jun 17 11:34:14.104638 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Auth-Token: gAAAAABirGa1in8urvf4ux7ncthta36wmdTEH9XyTFcrDtREP1FzVfLSv7oUPETQa8aKZ67yFVhupQSV7eoGMgnbJ9Qi-Yc29i-PYY10g1vd1HxJiOz1ZPyIgnJ9rB4oU2lIoHjD20q_F6immiONKkTWxIwiXe2tINEsSbEvWJkNS91nvRlertI Jun 17 11:34:14.104638 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Domain-Id: None Jun 17 11:34:14.104638 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Domain-Name: None Jun 17 11:34:14.104638 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Identity-Status: Confirmed Jun 17 11:34:14.104638 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Is-Admin-Project: True Jun 17 11:34:14.104638 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 11:34:14.104638 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Project-Domain-Id: default Jun 17 11:34:14.104638 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Project-Domain-Name: Default Jun 17 11:34:14.104638 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Project-Id: da8f91d479d0446f9019ff5f3ebd9584 Jun 17 11:34:14.104638 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Project-Name: admin Jun 17 11:34:14.104638 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Role: member,reader,admin Jun 17 11:34:14.104638 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Roles: member,reader,admin Jun 17 11:34:14.111855 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/da8f91d479d0446f9019ff5f3ebd9584"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_da8f91d479d0446f9019ff5f3ebd9584", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/da8f91d479d0446f9019ff5f3ebd9584"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/da8f91d479d0446f9019ff5f3ebd9584"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:34:14.111855 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Tenant: admin Jun 17 11:34:14.111855 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Tenant-Id: da8f91d479d0446f9019ff5f3ebd9584 Jun 17 11:34:14.111855 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Tenant-Name: admin Jun 17 11:34:14.111855 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-User: admin Jun 17 11:34:14.111855 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-User-Domain-Id: default Jun 17 11:34:14.111855 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-User-Domain-Name: Default Jun 17 11:34:14.111855 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-User-Id: d95b918a589c451e9aa78a47b3b6c6aa Jun 17 11:34:14.111855 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-User-Name: admin Jun 17 11:34:14.111855 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: method: > Jun 17 11:34:14.111855 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: exception: Flavor 42 could not be found. Jun 17 11:34:14.111855 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: action_args: {'id': '42'} Jun 17 11:34:14.111855 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:34:14.111855 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:34:14.112878 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 11:34:14.112878 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 11:34:14.112878 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 11:34:14.112878 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 11:34:14.112878 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 11:34:14.112878 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 11:34:14.112878 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 11:34:14.112878 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 11:34:14.112878 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 11:34:14.112878 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:34:14.112878 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 11:34:14.112878 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 11:34:14.112878 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 17 11:34:14.112878 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi Jun 17 11:34:14.112878 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:34:14.112878 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi Jun 17 11:34:14.112878 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:34:14.112878 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:34:14.112878 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:34:14.114159 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:34:14.114159 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:34:14.114159 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:34:14.114159 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:34:14.114159 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 11:34:14.114159 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:34:14.114159 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 17 11:34:14.114159 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi Jun 17 11:34:14.114159 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:34:14.114159 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi Jun 17 11:34:14.114159 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:34:14.114159 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:34:14.114159 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:34:14.114159 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:34:14.114159 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:34:14.114159 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 17 11:34:14.114159 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi Jun 17 11:34:14.114159 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-a34d454d-5ea9-4eff-a66c-174fc6793b7a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:34:14.115468 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-a34d454d-5ea9-4eff-a66c-174fc6793b7a admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015038 Jun 17 11:34:14.115468 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 22/42] 10.222.0.45 () {60 vars in 1190 bytes} [Fri Jun 17 11:34:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 11:34:15.010955 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-e6d76df4-01dc-4a1d-ad9f-ed8a97e6cc32 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:34:15.012019 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-e6d76df4-01dc-4a1d-ad9f-ed8a97e6cc32 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jun 17 11:34:15.012419 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 21/43] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Jun 17 11:34:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:34:15.224169 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-b98d9e10-33ee-411d-ac07-44a3659478d0 admin admin] Calling method '>' {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:34:15.226890 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.wsgi [None req-b98d9e10-33ee-411d-ac07-44a3659478d0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 17 11:34:15.228622 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-b98d9e10-33ee-411d-ac07-44a3659478d0 admin admin] Request method failure captured: Jun 17 11:34:15.228622 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 17 11:34:15.228622 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: Accept: application/json Jun 17 11:34:15.228622 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: Accept-Encoding: gzip, deflate Jun 17 11:34:15.228622 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: Connection: keep-alive Jun 17 11:34:15.228622 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: Content-Length: 0 Jun 17 11:34:15.228622 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: Host: 10.222.0.45 Jun 17 11:34:15.228622 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: Openstack-Api-Version: compute 2.90 Jun 17 11:34:15.228622 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: Openstack-System-Scope: None Jun 17 11:34:15.228622 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: User-Agent: python-novaclient Jun 17 11:34:15.228622 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Auth-Token: gAAAAABirGa24v6sTuWyMx9JkOtzupQqtFxKdRnmx-rabD7pv09zEFeai5Fdhc-02PgfkPt5MBNkaf3hWp7pqqIRNClkljGF7iREOH0j6twi54pO1cX0_akFCKJh9MFt1gYSE0bJ7a0vilmGJ1mAQIgF-3JqAmTDI6Czenr1LI0fnBTK1U_Rp68 Jun 17 11:34:15.228622 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Domain-Id: None Jun 17 11:34:15.228622 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Domain-Name: None Jun 17 11:34:15.228622 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Identity-Status: Confirmed Jun 17 11:34:15.228622 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Is-Admin-Project: True Jun 17 11:34:15.228622 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 11:34:15.228622 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Project-Domain-Id: default Jun 17 11:34:15.228622 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Project-Domain-Name: Default Jun 17 11:34:15.228622 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Project-Id: da8f91d479d0446f9019ff5f3ebd9584 Jun 17 11:34:15.228622 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Project-Name: admin Jun 17 11:34:15.228622 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Role: member,reader,admin Jun 17 11:34:15.228622 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Roles: member,reader,admin Jun 17 11:34:15.230237 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/da8f91d479d0446f9019ff5f3ebd9584"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_da8f91d479d0446f9019ff5f3ebd9584", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/da8f91d479d0446f9019ff5f3ebd9584"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/da8f91d479d0446f9019ff5f3ebd9584"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:34:15.230237 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Tenant: admin Jun 17 11:34:15.230237 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Tenant-Id: da8f91d479d0446f9019ff5f3ebd9584 Jun 17 11:34:15.230237 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Tenant-Name: admin Jun 17 11:34:15.230237 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-User: admin Jun 17 11:34:15.230237 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-User-Domain-Id: default Jun 17 11:34:15.230237 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-User-Domain-Name: Default Jun 17 11:34:15.230237 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-User-Id: d95b918a589c451e9aa78a47b3b6c6aa Jun 17 11:34:15.230237 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-User-Name: admin Jun 17 11:34:15.230237 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: method: > Jun 17 11:34:15.230237 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: exception: Flavor 84 could not be found. Jun 17 11:34:15.230237 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: action_args: {'id': '84'} Jun 17 11:34:15.230237 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:34:15.230237 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:34:15.231226 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 11:34:15.231226 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 11:34:15.231226 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 11:34:15.231226 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 11:34:15.231226 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 11:34:15.231226 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 11:34:15.231226 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 11:34:15.231226 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 11:34:15.231226 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 11:34:15.231226 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:34:15.231226 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 11:34:15.231226 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 11:34:15.231226 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 17 11:34:15.231226 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi Jun 17 11:34:15.231226 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:34:15.231226 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi Jun 17 11:34:15.231226 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:34:15.231226 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:34:15.231226 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:34:15.232666 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:34:15.232666 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:34:15.232666 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:34:15.232666 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:34:15.232666 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 11:34:15.232666 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:34:15.232666 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 17 11:34:15.232666 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi Jun 17 11:34:15.232666 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:34:15.232666 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi Jun 17 11:34:15.232666 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:34:15.232666 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:34:15.232666 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:34:15.232666 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:34:15.232666 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:34:15.232666 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 17 11:34:15.232666 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi Jun 17 11:34:15.232666 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-b98d9e10-33ee-411d-ac07-44a3659478d0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:34:15.233972 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-b98d9e10-33ee-411d-ac07-44a3659478d0 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.075139 Jun 17 11:34:15.235537 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 23/44] 10.222.0.45 () {60 vars in 1190 bytes} [Fri Jun 17 11:34:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 11:34:15.241308 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-624ed3c7-f446-4b13-81de-97750943feb9 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:34:15.258366 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-624ed3c7-f446-4b13-81de-97750943feb9 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021012 Jun 17 11:34:15.258957 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 22/45] 10.222.0.45 () {60 vars in 1210 bytes} [Fri Jun 17 11:34:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:34:15.269878 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-d53bd379-56f5-4a6e-9d85-c8b83e30a4e0 admin admin] Calling method '>' {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:34:15.286511 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-d53bd379-56f5-4a6e-9d85-c8b83e30a4e0 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020948 Jun 17 11:34:15.287154 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 24/46] 10.222.0.45 () {60 vars in 1210 bytes} [Fri Jun 17 11:34:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:34:15.297706 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-9b28de69-a4ef-4ea7-a144-6e4b6345280d admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:34:15.303739 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.wsgi [None req-9b28de69-a4ef-4ea7-a144-6e4b6345280d admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 17 11:34:15.305301 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-9b28de69-a4ef-4ea7-a144-6e4b6345280d admin admin] Request method failure captured: Jun 17 11:34:15.305301 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 17 11:34:15.305301 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: Accept: application/json Jun 17 11:34:15.305301 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: Accept-Encoding: gzip, deflate Jun 17 11:34:15.305301 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: Connection: keep-alive Jun 17 11:34:15.305301 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: Content-Length: 0 Jun 17 11:34:15.305301 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: Host: 10.222.0.45 Jun 17 11:34:15.305301 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: Openstack-Api-Version: compute 2.90 Jun 17 11:34:15.305301 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: Openstack-System-Scope: None Jun 17 11:34:15.305301 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: User-Agent: python-novaclient Jun 17 11:34:15.305301 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Auth-Token: gAAAAABirGa24v6sTuWyMx9JkOtzupQqtFxKdRnmx-rabD7pv09zEFeai5Fdhc-02PgfkPt5MBNkaf3hWp7pqqIRNClkljGF7iREOH0j6twi54pO1cX0_akFCKJh9MFt1gYSE0bJ7a0vilmGJ1mAQIgF-3JqAmTDI6Czenr1LI0fnBTK1U_Rp68 Jun 17 11:34:15.305301 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Domain-Id: None Jun 17 11:34:15.305301 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Domain-Name: None Jun 17 11:34:15.305301 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Identity-Status: Confirmed Jun 17 11:34:15.305301 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Is-Admin-Project: True Jun 17 11:34:15.305301 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 11:34:15.305301 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Project-Domain-Id: default Jun 17 11:34:15.305301 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Project-Domain-Name: Default Jun 17 11:34:15.305301 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Project-Id: da8f91d479d0446f9019ff5f3ebd9584 Jun 17 11:34:15.305301 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Project-Name: admin Jun 17 11:34:15.305301 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Role: member,reader,admin Jun 17 11:34:15.305301 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Roles: member,reader,admin Jun 17 11:34:15.306939 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/da8f91d479d0446f9019ff5f3ebd9584"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_da8f91d479d0446f9019ff5f3ebd9584", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/da8f91d479d0446f9019ff5f3ebd9584"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/da8f91d479d0446f9019ff5f3ebd9584"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:34:15.306939 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Tenant: admin Jun 17 11:34:15.306939 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Tenant-Id: da8f91d479d0446f9019ff5f3ebd9584 Jun 17 11:34:15.306939 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Tenant-Name: admin Jun 17 11:34:15.306939 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-User: admin Jun 17 11:34:15.306939 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-User-Domain-Id: default Jun 17 11:34:15.306939 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-User-Domain-Name: Default Jun 17 11:34:15.306939 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-User-Id: d95b918a589c451e9aa78a47b3b6c6aa Jun 17 11:34:15.306939 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-User-Name: admin Jun 17 11:34:15.306939 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: method: > Jun 17 11:34:15.306939 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: exception: Flavor 84 could not be found. Jun 17 11:34:15.306939 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: action_args: {'id': '84'} Jun 17 11:34:15.306939 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:34:15.306939 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:34:15.308052 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 11:34:15.308052 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 11:34:15.308052 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 11:34:15.308052 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 11:34:15.308052 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 11:34:15.308052 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 11:34:15.308052 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 11:34:15.308052 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 11:34:15.308052 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 11:34:15.308052 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:34:15.308052 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 11:34:15.308052 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 11:34:15.308052 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 17 11:34:15.308052 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Jun 17 11:34:15.308052 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:34:15.308052 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Jun 17 11:34:15.308052 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:34:15.308052 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:34:15.308052 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:34:15.309502 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:34:15.309502 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:34:15.309502 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:34:15.309502 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:34:15.309502 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 11:34:15.309502 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:34:15.309502 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 17 11:34:15.309502 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Jun 17 11:34:15.309502 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:34:15.309502 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Jun 17 11:34:15.309502 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:34:15.309502 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:34:15.309502 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:34:15.309502 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:34:15.309502 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:34:15.309502 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 17 11:34:15.309502 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Jun 17 11:34:15.309502 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-9b28de69-a4ef-4ea7-a144-6e4b6345280d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:34:15.310787 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-9b28de69-a4ef-4ea7-a144-6e4b6345280d admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012878 Jun 17 11:34:15.310787 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 23/47] 10.222.0.45 () {60 vars in 1190 bytes} [Fri Jun 17 11:34:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 17 11:34:16.197741 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-d53bd379-56f5-4a6e-9d85-c8b83e30a4e0 admin admin] Calling method '>' {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:34:16.198816 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-d53bd379-56f5-4a6e-9d85-c8b83e30a4e0 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Jun 17 11:34:16.199261 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 25/48] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Jun 17 11:34:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:34:16.461067 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-5c8344c6-dfd2-43b2-9f79-5550657ce7cb admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:34:16.461067 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.wsgi [None req-5c8344c6-dfd2-43b2-9f79-5550657ce7cb admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 17 11:34:16.461067 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-5c8344c6-dfd2-43b2-9f79-5550657ce7cb admin admin] Request method failure captured: Jun 17 11:34:16.461067 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 17 11:34:16.461067 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: Accept: application/json Jun 17 11:34:16.461067 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: Accept-Encoding: gzip, deflate Jun 17 11:34:16.461067 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: Connection: keep-alive Jun 17 11:34:16.461067 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: Content-Length: 0 Jun 17 11:34:16.461067 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: Host: 10.222.0.45 Jun 17 11:34:16.461067 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: Openstack-Api-Version: compute 2.90 Jun 17 11:34:16.461067 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: Openstack-System-Scope: None Jun 17 11:34:16.461067 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: User-Agent: python-novaclient Jun 17 11:34:16.461067 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Auth-Token: gAAAAABirGa42XBxzUSzGX01-UloPQTqttzutWst_r-jo2eLqluYVHOGYalGJPJuJ3pRiy0GEib2-DnBZDThb-Pbht1Cphfk-qOXL61c2K2esMf2fbFJTIsw6_zn1rqVlXHOuXyQcSYql5NDkdSQOD5GlCnZDhH14gcU3F7RfYz7-fk0CTHU46E Jun 17 11:34:16.461067 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Domain-Id: None Jun 17 11:34:16.461067 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Domain-Name: None Jun 17 11:34:16.461067 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Identity-Status: Confirmed Jun 17 11:34:16.461067 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Is-Admin-Project: True Jun 17 11:34:16.461067 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 11:34:16.461067 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Project-Domain-Id: default Jun 17 11:34:16.461067 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Project-Domain-Name: Default Jun 17 11:34:16.461067 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Project-Id: da8f91d479d0446f9019ff5f3ebd9584 Jun 17 11:34:16.461067 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Project-Name: admin Jun 17 11:34:16.461067 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Role: member,reader,admin Jun 17 11:34:16.461067 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Roles: member,reader,admin Jun 17 11:34:16.463262 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/da8f91d479d0446f9019ff5f3ebd9584"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_da8f91d479d0446f9019ff5f3ebd9584", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/da8f91d479d0446f9019ff5f3ebd9584"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/da8f91d479d0446f9019ff5f3ebd9584"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:34:16.463262 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Tenant: admin Jun 17 11:34:16.463262 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Tenant-Id: da8f91d479d0446f9019ff5f3ebd9584 Jun 17 11:34:16.463262 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-Tenant-Name: admin Jun 17 11:34:16.463262 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-User: admin Jun 17 11:34:16.463262 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-User-Domain-Id: default Jun 17 11:34:16.463262 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-User-Domain-Name: Default Jun 17 11:34:16.463262 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-User-Id: d95b918a589c451e9aa78a47b3b6c6aa Jun 17 11:34:16.463262 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: X-User-Name: admin Jun 17 11:34:16.463262 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: method: > Jun 17 11:34:16.463262 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: exception: Flavor 451 could not be found. Jun 17 11:34:16.463262 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: action_args: {'id': '451'} Jun 17 11:34:16.463262 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:34:16.463262 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:34:16.464338 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 11:34:16.464338 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 11:34:16.464338 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 11:34:16.464338 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 11:34:16.464338 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 11:34:16.464338 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 11:34:16.464338 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 11:34:16.464338 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 11:34:16.464338 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 11:34:16.464338 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:34:16.464338 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 11:34:16.464338 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 11:34:16.464338 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 17 11:34:16.464338 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Jun 17 11:34:16.464338 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:34:16.464338 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Jun 17 11:34:16.464338 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:34:16.464338 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:34:16.464338 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:34:16.465772 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:34:16.465772 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:34:16.465772 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:34:16.465772 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:34:16.465772 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 11:34:16.465772 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:34:16.465772 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 17 11:34:16.465772 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Jun 17 11:34:16.465772 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:34:16.465772 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Jun 17 11:34:16.465772 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:34:16.465772 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:34:16.465772 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:34:16.465772 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:34:16.465772 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:34:16.465772 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 17 11:34:16.465772 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Jun 17 11:34:16.465772 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-5c8344c6-dfd2-43b2-9f79-5550657ce7cb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:34:16.467044 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-5c8344c6-dfd2-43b2-9f79-5550657ce7cb admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.067281 Jun 17 11:34:16.467044 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 24/49] 10.222.0.45 () {60 vars in 1193 bytes} [Fri Jun 17 11:34:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 11:34:16.467223 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-d0694996-0083-40eb-a3ff-e719e17b018c admin admin] Calling method '>' {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:34:16.467223 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-d0694996-0083-40eb-a3ff-e719e17b018c admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019275 Jun 17 11:34:16.467223 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 26/50] 10.222.0.45 () {60 vars in 1210 bytes} [Fri Jun 17 11:34:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:34:16.467828 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-9be4a39f-c9ac-4c9d-b851-db2b3ffa56c7 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:34:16.470395 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-9be4a39f-c9ac-4c9d-b851-db2b3ffa56c7 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019729 Jun 17 11:34:16.471004 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 25/51] 10.222.0.45 () {60 vars in 1210 bytes} [Fri Jun 17 11:34:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:34:16.481202 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-d3d27795-a80c-434d-a8d7-60783a5718bf admin admin] Calling method '>' {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:34:16.487989 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.wsgi [None req-d3d27795-a80c-434d-a8d7-60783a5718bf admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 17 11:34:16.489492 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-d3d27795-a80c-434d-a8d7-60783a5718bf admin admin] Request method failure captured: Jun 17 11:34:16.489492 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 17 11:34:16.489492 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: Accept: application/json Jun 17 11:34:16.489492 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: Accept-Encoding: gzip, deflate Jun 17 11:34:16.489492 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: Connection: keep-alive Jun 17 11:34:16.489492 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: Content-Length: 0 Jun 17 11:34:16.489492 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: Host: 10.222.0.45 Jun 17 11:34:16.489492 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: Openstack-Api-Version: compute 2.90 Jun 17 11:34:16.489492 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: Openstack-System-Scope: None Jun 17 11:34:16.489492 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: User-Agent: python-novaclient Jun 17 11:34:16.489492 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Auth-Token: gAAAAABirGa42XBxzUSzGX01-UloPQTqttzutWst_r-jo2eLqluYVHOGYalGJPJuJ3pRiy0GEib2-DnBZDThb-Pbht1Cphfk-qOXL61c2K2esMf2fbFJTIsw6_zn1rqVlXHOuXyQcSYql5NDkdSQOD5GlCnZDhH14gcU3F7RfYz7-fk0CTHU46E Jun 17 11:34:16.489492 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Domain-Id: None Jun 17 11:34:16.489492 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Domain-Name: None Jun 17 11:34:16.489492 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Identity-Status: Confirmed Jun 17 11:34:16.489492 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Is-Admin-Project: True Jun 17 11:34:16.489492 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 11:34:16.489492 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Project-Domain-Id: default Jun 17 11:34:16.489492 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Project-Domain-Name: Default Jun 17 11:34:16.489492 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Project-Id: da8f91d479d0446f9019ff5f3ebd9584 Jun 17 11:34:16.489492 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Project-Name: admin Jun 17 11:34:16.489492 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Role: member,reader,admin Jun 17 11:34:16.489492 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Roles: member,reader,admin Jun 17 11:34:16.491097 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/da8f91d479d0446f9019ff5f3ebd9584"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_da8f91d479d0446f9019ff5f3ebd9584", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/da8f91d479d0446f9019ff5f3ebd9584"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/da8f91d479d0446f9019ff5f3ebd9584"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:34:16.491097 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Tenant: admin Jun 17 11:34:16.491097 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Tenant-Id: da8f91d479d0446f9019ff5f3ebd9584 Jun 17 11:34:16.491097 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-Tenant-Name: admin Jun 17 11:34:16.491097 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-User: admin Jun 17 11:34:16.491097 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-User-Domain-Id: default Jun 17 11:34:16.491097 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-User-Domain-Name: Default Jun 17 11:34:16.491097 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-User-Id: d95b918a589c451e9aa78a47b3b6c6aa Jun 17 11:34:16.491097 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: X-User-Name: admin Jun 17 11:34:16.491097 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: method: > Jun 17 11:34:16.491097 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: exception: Flavor 451 could not be found. Jun 17 11:34:16.491097 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: action_args: {'id': '451'} Jun 17 11:34:16.491097 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:34:16.491097 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:34:16.492144 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 11:34:16.492144 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 11:34:16.492144 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 11:34:16.492144 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 11:34:16.492144 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 11:34:16.492144 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 11:34:16.492144 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 11:34:16.492144 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 11:34:16.492144 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 11:34:16.492144 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:34:16.492144 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 11:34:16.492144 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 11:34:16.492144 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 17 11:34:16.492144 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi Jun 17 11:34:16.492144 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:34:16.492144 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi Jun 17 11:34:16.492144 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:34:16.492144 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:34:16.492144 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:34:16.493329 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:34:16.493329 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:34:16.493329 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:34:16.493329 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:34:16.493329 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 11:34:16.493329 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:34:16.493329 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 17 11:34:16.493329 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi Jun 17 11:34:16.493329 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:34:16.493329 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi Jun 17 11:34:16.493329 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:34:16.493329 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:34:16.493329 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:34:16.493329 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:34:16.493329 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:34:16.493329 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 17 11:34:16.493329 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: ERROR nova.api.openstack.wsgi Jun 17 11:34:16.493329 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-d3d27795-a80c-434d-a8d7-60783a5718bf admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:34:16.494397 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-d3d27795-a80c-434d-a8d7-60783a5718bf admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013615 Jun 17 11:34:16.494397 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 27/52] 10.222.0.45 () {60 vars in 1193 bytes} [Fri Jun 17 11:34:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 11:34:17.401274 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-9be4a39f-c9ac-4c9d-b851-db2b3ffa56c7 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:34:17.402297 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-9be4a39f-c9ac-4c9d-b851-db2b3ffa56c7 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jun 17 11:34:17.402711 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 26/53] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Jun 17 11:34:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:34:17.605937 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-e062eb1e-68a1-446d-81b8-5381e34a5ea4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:34:17.730806 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-e062eb1e-68a1-446d-81b8-5381e34a5ea4 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.180115 Jun 17 11:34:17.731324 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 28/54] 10.222.0.45 () {64 vars in 1235 bytes} [Fri Jun 17 11:34:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 11:34:18.622433 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-9be4a39f-c9ac-4c9d-b851-db2b3ffa56c7 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:34:18.623608 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-9be4a39f-c9ac-4c9d-b851-db2b3ffa56c7 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001568 Jun 17 11:34:18.624017 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 27/55] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Jun 17 11:34:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:34:18.829909 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-ecae2a9b-7305-4585-901d-068c0d5a4c99 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:34:18.947687 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-ecae2a9b-7305-4585-901d-068c0d5a4c99 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.177840 Jun 17 11:34:18.948249 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 29/56] 10.222.0.45 () {64 vars in 1235 bytes} [Fri Jun 17 11:34:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 11:34:19.835832 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-9be4a39f-c9ac-4c9d-b851-db2b3ffa56c7 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:34:19.836912 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-9be4a39f-c9ac-4c9d-b851-db2b3ffa56c7 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 Jun 17 11:34:19.837352 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 28/57] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Jun 17 11:34:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:34:20.038958 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-fea365ac-a8c6-479a-bc11-98f5db09053e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:34:20.125822 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-fea365ac-a8c6-479a-bc11-98f5db09053e admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.148000 Jun 17 11:34:20.126435 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 30/58] 10.222.0.45 () {64 vars in 1235 bytes} [Fri Jun 17 11:34:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 11:34:21.024690 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-9be4a39f-c9ac-4c9d-b851-db2b3ffa56c7 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:34:21.025701 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-9be4a39f-c9ac-4c9d-b851-db2b3ffa56c7 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jun 17 11:34:21.026104 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 29/59] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Jun 17 11:34:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:34:21.226867 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-77f9fda2-4058-47fb-b70d-d1c9a78904b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:34:21.304519 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-77f9fda2-4058-47fb-b70d-d1c9a78904b1 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.135707 Jun 17 11:34:21.304985 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 31/60] 10.222.0.45 () {64 vars in 1235 bytes} [Fri Jun 17 11:34:21 2022] POST /compute/v2.1/flavors => generated 409 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 11:34:22.194804 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-9be4a39f-c9ac-4c9d-b851-db2b3ffa56c7 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:34:22.195874 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-9be4a39f-c9ac-4c9d-b851-db2b3ffa56c7 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Jun 17 11:34:22.196309 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 30/61] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Jun 17 11:34:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:34:22.404922 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-16d8c26a-ee78-47f6-a26d-0caaae227a54 admin admin] Calling method '>' {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:34:22.426836 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-16d8c26a-ee78-47f6-a26d-0caaae227a54 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.084692 Jun 17 11:34:22.427543 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 32/62] 10.222.0.45 () {60 vars in 1202 bytes} [Fri Jun 17 11:34:22 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:35:12.578305 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-9be4a39f-c9ac-4c9d-b851-db2b3ffa56c7 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:35:12.579327 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-9be4a39f-c9ac-4c9d-b851-db2b3ffa56c7 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jun 17 11:35:12.579774 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 31/63] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jun 17 11:35:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:35:12.591111 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG dbcounter [-] [110437] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:35:12.645643 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-7c74c49f-82d0-4474-9d1c-3be18341e66f admin admin] Calling method '>' {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:35:12.666294 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-7c74c49f-82d0-4474-9d1c-3be18341e66f admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.079593 Jun 17 11:35:12.666875 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 33/64] 10.222.0.45 () {60 vars in 1291 bytes} [Fri Jun 17 11:35:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:35:12.692053 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-dbcb5b3b-3c13-4916-a7a0-6afc1547863b admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:35:12.695790 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:35:12.701457 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-dbcb5b3b-3c13-4916-a7a0-6afc1547863b admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013029 Jun 17 11:35:12.702032 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 32/65] 10.222.0.45 () {60 vars in 1282 bytes} [Fri Jun 17 11:35:12 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:35:12.714713 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-06675292-ca96-45df-991e-c267118813ec admin admin] Calling method '>' {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:35:12.723497 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-06675292-ca96-45df-991e-c267118813ec admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012317 Jun 17 11:35:12.724007 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 34/66] 10.222.0.45 () {60 vars in 1285 bytes} [Fri Jun 17 11:35:12 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:35:12.737468 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-1b44632a-f8b7-4b2c-b938-176f167e1426 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:35:12.745513 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-1b44632a-f8b7-4b2c-b938-176f167e1426 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012346 Jun 17 11:35:12.746054 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 33/67] 10.222.0.45 () {60 vars in 1285 bytes} [Fri Jun 17 11:35:12 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:35:12.758763 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-17447658-999a-47bc-93f2-80466a86bc8e admin admin] Calling method '>' {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:35:12.767026 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-17447658-999a-47bc-93f2-80466a86bc8e admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011956 Jun 17 11:35:12.767407 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 35/68] 10.222.0.45 () {60 vars in 1282 bytes} [Fri Jun 17 11:35:12 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:38:46.991697 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-1b44632a-f8b7-4b2c-b938-176f167e1426 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:38:46.992756 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-1b44632a-f8b7-4b2c-b938-176f167e1426 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001648 Jun 17 11:38:46.993261 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 34/69] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Jun 17 11:38:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:38:47.157045 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG dbcounter [-] [110437] Writing DB stats nova_api:SELECT=6 {{(pid=110437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:38:47.294544 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-8e1998a8-808f-432b-b6c9-6fde29873b00 admin admin] Calling method '>' {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:38:47.294544 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 11:38:47.294544 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: warnings.warn(msg) Jun 17 11:38:47.294544 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG oslo_concurrency.lockutils [None req-8e1998a8-808f-432b-b6c9-6fde29873b00 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:38:47.294544 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG oslo_concurrency.lockutils [None req-8e1998a8-808f-432b-b6c9-6fde29873b00 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:38:47.294544 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG oslo_concurrency.lockutils [None req-8e1998a8-808f-432b-b6c9-6fde29873b00 admin admin] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:38:47.295077 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG oslo_concurrency.lockutils [None req-8e1998a8-808f-432b-b6c9-6fde29873b00 admin admin] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:38:47.321424 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-8e1998a8-808f-432b-b6c9-6fde29873b00 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.166063 Jun 17 11:38:47.322012 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 36/70] 10.222.0.45 () {60 vars in 1193 bytes} [Fri Jun 17 11:38:47 2022] GET /compute/v2.1/os-services => generated 791 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 11:38:48.234424 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-1b44632a-f8b7-4b2c-b938-176f167e1426 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:38:48.236317 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-1b44632a-f8b7-4b2c-b938-176f167e1426 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jun 17 11:38:48.236717 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 35/71] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Jun 17 11:38:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:38:48.434710 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-a6da5e90-82f6-4ccc-b682-b795b83d6c7d admin admin] Calling method '>' {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:38:48.435928 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 11:38:48.435928 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: warnings.warn(msg) Jun 17 11:38:48.437102 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG oslo_concurrency.lockutils [None req-a6da5e90-82f6-4ccc-b682-b795b83d6c7d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:38:48.437542 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG oslo_concurrency.lockutils [None req-a6da5e90-82f6-4ccc-b682-b795b83d6c7d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:38:48.438376 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG oslo_concurrency.lockutils [None req-a6da5e90-82f6-4ccc-b682-b795b83d6c7d admin admin] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:38:48.439570 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG oslo_concurrency.lockutils [None req-a6da5e90-82f6-4ccc-b682-b795b83d6c7d admin admin] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:38:48.461056 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-a6da5e90-82f6-4ccc-b682-b795b83d6c7d admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.080263 Jun 17 11:38:48.461642 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 37/72] 10.222.0.45 () {60 vars in 1193 bytes} [Fri Jun 17 11:38:48 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 11:38:59.811937 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-1b44632a-f8b7-4b2c-b938-176f167e1426 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:38:59.812934 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-1b44632a-f8b7-4b2c-b938-176f167e1426 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jun 17 11:38:59.813325 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 36/73] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Jun 17 11:38:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:38:59.960214 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG dbcounter [-] [110437] Writing DB stats nova_cell0:SELECT=4 {{(pid=110437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:38:59.960861 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG dbcounter [-] [110437] Writing DB stats nova_cell1:SELECT=4 {{(pid=110437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:38:59.961471 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG dbcounter [-] [110437] Writing DB stats nova_api:SELECT=8 {{(pid=110437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:39:00.010842 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-4c02b553-1f9f-4867-8978-2648018595e3 admin admin] Calling method '>' {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:39:00.012083 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 11:39:00.012083 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: warnings.warn(msg) Jun 17 11:39:00.013282 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG oslo_concurrency.lockutils [None req-4c02b553-1f9f-4867-8978-2648018595e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:39:00.013729 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG oslo_concurrency.lockutils [None req-4c02b553-1f9f-4867-8978-2648018595e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:39:00.014575 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG oslo_concurrency.lockutils [None req-4c02b553-1f9f-4867-8978-2648018595e3 admin admin] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:39:00.015032 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG oslo_concurrency.lockutils [None req-4c02b553-1f9f-4867-8978-2648018595e3 admin admin] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:39:00.041383 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-4c02b553-1f9f-4867-8978-2648018595e3 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086964 Jun 17 11:39:00.041950 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 38/74] 10.222.0.45 () {60 vars in 1193 bytes} [Fri Jun 17 11:38:59 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:39:00.945174 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-1b44632a-f8b7-4b2c-b938-176f167e1426 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:39:00.946193 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-1b44632a-f8b7-4b2c-b938-176f167e1426 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jun 17 11:39:00.946645 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 37/75] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Jun 17 11:39:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:39:01.142632 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG nova.api.openstack.wsgi [None req-d0086400-e56d-47e8-a03f-21000c33cc8c admin admin] Calling method '>' {{(pid=110437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:39:01.144001 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 11:39:01.144001 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: warnings.warn(msg) Jun 17 11:39:01.145256 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG oslo_concurrency.lockutils [None req-d0086400-e56d-47e8-a03f-21000c33cc8c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:39:01.145702 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG oslo_concurrency.lockutils [None req-d0086400-e56d-47e8-a03f-21000c33cc8c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:39:01.146491 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG oslo_concurrency.lockutils [None req-d0086400-e56d-47e8-a03f-21000c33cc8c admin admin] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:39:01.146948 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: DEBUG oslo_concurrency.lockutils [None req-d0086400-e56d-47e8-a03f-21000c33cc8c admin admin] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:39:01.169137 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: INFO nova.api.openstack.requestlog [None req-d0086400-e56d-47e8-a03f-21000c33cc8c admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079818 Jun 17 11:39:01.169632 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: [pid: 110437|app: 0|req: 39/76] 10.222.0.45 () {60 vars in 1193 bytes} [Fri Jun 17 11:39:01 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:40:02.275007 dv-cinder-837166-3-iscsi devstack@n-api.service[110435]: Fri Jun 17 11:40:02 2022 - graceful shutdown triggered... Jun 17 11:40:02.275593 dv-cinder-837166-3-iscsi devstack@n-api.service[110437]: Gracefully killing worker 2 (pid: 110437)... Jun 17 11:40:02.275958 dv-cinder-837166-3-iscsi devstack@n-api.service[110436]: Gracefully killing worker 1 (pid: 110436)... Jun 17 11:40:02.275752 dv-cinder-837166-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 17 11:40:03.275709 dv-cinder-837166-3-iscsi devstack@n-api.service[110435]: worker 1 buried after 1 seconds Jun 17 11:40:03.275709 dv-cinder-837166-3-iscsi devstack@n-api.service[110435]: worker 2 buried after 1 seconds Jun 17 11:40:03.276375 dv-cinder-837166-3-iscsi devstack@n-api.service[110435]: goodbye to uWSGI. Jun 17 11:40:03.277295 dv-cinder-837166-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 17 11:40:03.277841 dv-cinder-837166-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 17 11:40:03.281416 dv-cinder-837166-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 17 11:40:03.292491 dv-cinder-837166-3-iscsi devstack@n-api.service[124824]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 17 11:40:03.295707 dv-cinder-837166-3-iscsi devstack@n-api.service[124824]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 17 11:40:03 2022] *** Jun 17 11:40:03.295707 dv-cinder-837166-3-iscsi devstack@n-api.service[124824]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 17 11:40:03.295707 dv-cinder-837166-3-iscsi devstack@n-api.service[124824]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 17 11:40:03.295707 dv-cinder-837166-3-iscsi devstack@n-api.service[124824]: nodename: dv-cinder-837166-3-iscsi Jun 17 11:40:03.295707 dv-cinder-837166-3-iscsi devstack@n-api.service[124824]: machine: x86_64 Jun 17 11:40:03.295707 dv-cinder-837166-3-iscsi devstack@n-api.service[124824]: clock source: unix Jun 17 11:40:03.295707 dv-cinder-837166-3-iscsi devstack@n-api.service[124824]: pcre jit disabled Jun 17 11:40:03.295707 dv-cinder-837166-3-iscsi devstack@n-api.service[124824]: detected number of CPU cores: 4 Jun 17 11:40:03.295707 dv-cinder-837166-3-iscsi devstack@n-api.service[124824]: current working directory: / Jun 17 11:40:03.295707 dv-cinder-837166-3-iscsi devstack@n-api.service[124824]: detected binary path: /usr/bin/uwsgi-core Jun 17 11:40:03.295707 dv-cinder-837166-3-iscsi devstack@n-api.service[124824]: your processes number limit is 47680 Jun 17 11:40:03.295707 dv-cinder-837166-3-iscsi devstack@n-api.service[124824]: your memory page size is 4096 bytes Jun 17 11:40:03.295707 dv-cinder-837166-3-iscsi devstack@n-api.service[124824]: detected max file descriptor number: 2048 Jun 17 11:40:03.295707 dv-cinder-837166-3-iscsi devstack@n-api.service[124824]: lock engine: pthread robust mutexes Jun 17 11:40:03.296632 dv-cinder-837166-3-iscsi devstack@n-api.service[124824]: thunder lock: enabled Jun 17 11:40:03.296632 dv-cinder-837166-3-iscsi devstack@n-api.service[124824]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 17 11:40:03.296632 dv-cinder-837166-3-iscsi devstack@n-api.service[124824]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 17 11:40:03.344565 dv-cinder-837166-3-iscsi devstack@n-api.service[124824]: Python main interpreter initialized at 0x55c910a729c0 Jun 17 11:40:03.344565 dv-cinder-837166-3-iscsi devstack@n-api.service[124824]: python threads support enabled Jun 17 11:40:03.344565 dv-cinder-837166-3-iscsi devstack@n-api.service[124824]: your server socket listen backlog is limited to 100 connections Jun 17 11:40:03.344565 dv-cinder-837166-3-iscsi devstack@n-api.service[124824]: your mercy for graceful operations on workers is 90 seconds Jun 17 11:40:03.345084 dv-cinder-837166-3-iscsi devstack@n-api.service[124824]: mapped 403077 bytes (393 KB) for 2 cores Jun 17 11:40:03.345084 dv-cinder-837166-3-iscsi devstack@n-api.service[124824]: *** Operational MODE: preforking *** Jun 17 11:40:03.345315 dv-cinder-837166-3-iscsi devstack@n-api.service[124824]: *** uWSGI is running in multiple interpreter mode *** Jun 17 11:40:03.345315 dv-cinder-837166-3-iscsi devstack@n-api.service[124824]: spawned uWSGI master process (pid: 124824) Jun 17 11:40:03.345520 dv-cinder-837166-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 17 11:40:03.346101 dv-cinder-837166-3-iscsi devstack@n-api.service[124824]: spawned uWSGI worker 1 (pid: 124844, cores: 1) Jun 17 11:40:03.346604 dv-cinder-837166-3-iscsi devstack@n-api.service[124824]: spawned uWSGI worker 2 (pid: 124845, cores: 1) Jun 17 11:40:03.346886 dv-cinder-837166-3-iscsi devstack@n-api.service[124824]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 17 11:40:04.019841 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 17 11:40:04.023234 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 17 11:40:05.298689 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 11:40:05.298689 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: from cryptography.utils import int_from_bytes Jun 17 11:40:05.299479 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 11:40:05.299479 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: from cryptography.utils import int_from_bytes Jun 17 11:40:05.303931 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 11:40:05.303931 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: from cryptography.utils import int_from_bytes Jun 17 11:40:05.304368 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 11:40:05.304368 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: from cryptography.utils import int_from_bytes Jun 17 11:40:07.760246 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 11:40:07.761020 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 11:40:07.761145 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 11:40:07.761434 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 11:40:07.761696 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 11:40:07.762089 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.762419 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.762743 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.763067 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.763419 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.764295 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.764621 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.764943 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.765273 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.765537 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.765859 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.766185 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837166-3-iscsi {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.766508 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.766820 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.767182 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.767535 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.767851 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.768177 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.768487 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.768984 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.769444 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.769764 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.770091 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.770416 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.770734 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.771050 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.771384 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.771719 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.772048 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.772518 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.772819 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837166-3-iscsi {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.773141 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.773455 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.773772 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.774189 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.774504 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.774817 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.775140 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.775503 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.775824 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.776152 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.776473 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.776813 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.777118 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.777423 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.777734 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.778050 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.778367 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.778678 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.778983 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.779505 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.779651 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.779968 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.783853 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 11:40:07.783853 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 11:40:07.784512 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.784512 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.784837 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 11:40:07.785004 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.785004 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.785307 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 11:40:07.785466 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.785621 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 11:40:07.785779 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.785936 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.786091 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.786249 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.786408 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.786586 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.786745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.786912 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.787070 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.787228 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.787498 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.787668 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.787829 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.788004 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.788168 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.788335 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.788491 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.788645 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.788799 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.789162 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.789333 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.789548 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.789711 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.789859 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837166-3-iscsi {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.790022 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.790257 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.790410 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.790611 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.790775 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.790931 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.791084 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.791238 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.791438 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.791639 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.791790 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.791957 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.792111 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.792257 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.792418 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.792418 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.792753 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.792931 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.793086 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.793257 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.793404 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.793604 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.793762 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.793916 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.794072 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.794234 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.794393 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.794549 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.794708 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.794998 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.795238 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.795480 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.795843 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.796010 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.796167 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.796313 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.796459 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.796623 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.796779 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837166-3-iscsi {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.796969 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.797129 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.797283 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.797443 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.797590 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.797590 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.797896 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.798051 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.798207 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.798365 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.798520 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.798677 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.798836 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.799017 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.799340 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.799532 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.799691 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.799846 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.800011 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.800172 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.800420 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.800585 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.800747 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.800905 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.801099 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.801264 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.801429 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.801592 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.801749 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.801915 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.802063 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.802234 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.802381 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.802538 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.802686 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.802844 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.802998 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.803144 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.803300 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.803470 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.803635 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.803790 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.803945 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.804100 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.804257 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.804404 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.804560 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.804707 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.804863 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.805023 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.805213 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.805213 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.805537 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.805537 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.805826 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.805984 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.806139 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.806297 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.806453 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.806607 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.806764 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.806918 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.807064 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.807223 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.807486 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.807656 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.807804 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.807960 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.808127 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.808282 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.808440 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.808588 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.808742 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.808888 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.809047 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.809309 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.809535 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.809696 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.809844 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.810000 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.810160 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.810329 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.811066 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.811233 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.811401 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.811573 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.811813 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.811977 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.812131 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.812278 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.812434 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.812600 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.812748 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.812914 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.813062 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.813207 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.813385 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.813550 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.813707 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.813854 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.814007 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.814153 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.814307 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.814307 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.814602 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.814748 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.814913 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.814913 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.815199 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.815355 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.815577 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.815577 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.815854 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.816008 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.816164 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.816312 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.816463 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.816611 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.816770 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.816933 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.817089 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.817313 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.817504 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.817669 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.817817 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.817971 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.818126 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.818274 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.818274 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.818561 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.818709 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.818862 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.819034 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.819189 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.819355 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.819671 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.819826 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.819987 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.820142 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.820289 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.820435 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.820587 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.820740 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.820902 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.821085 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.821315 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.821477 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.821624 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.821776 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.821947 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.822095 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.822250 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.822398 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.822551 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.822717 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.822872 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.823034 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.823034 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.823349 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.823521 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.823679 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.823833 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.823982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.824139 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.824299 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.824447 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.824600 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.824747 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.824901 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.825062 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.825219 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.825366 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.825554 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.825708 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.825864 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.826685 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.826876 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.827027 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.827183 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.827340 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.827538 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.827705 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.827869 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.828041 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.828200 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.828347 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.828501 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.828656 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.828817 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.828965 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.829119 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.829275 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.829422 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.829585 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.829936 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.830110 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.830268 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.830416 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.830562 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.830716 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.830914 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.831069 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.831217 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.831477 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.831640 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.831804 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.831959 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.832110 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.832275 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.832425 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 11:40:07.832572 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.832732 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.832880 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.833026 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.833181 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.833181 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.833462 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.833662 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.833816 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.833964 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.834110 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.834280 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.834444 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.834592 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.834745 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.834899 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.835046 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.835199 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.835355 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.835532 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.835679 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.835836 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.835990 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.836156 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.836314 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.836469 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.836624 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.836777 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.836924 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.837070 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.837225 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.837390 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.837547 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.837695 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.837841 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.837995 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.838153 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.838299 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.838444 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.838598 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.838746 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.838970 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.839119 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.839265 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.839448 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.839601 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.839761 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.840074 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.840236 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.840403 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.840559 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.840716 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.840872 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.841033 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.841180 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.841334 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.841878 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.842041 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.842199 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.842353 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.842500 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.842657 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.842805 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.842958 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.842958 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.843246 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.843428 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.843593 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.843748 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.843903 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.844059 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.844206 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.844361 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.844508 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.844666 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.844812 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.844971 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.845119 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.845273 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.845428 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.845583 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.845744 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.845898 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.846053 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.846207 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.846362 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.846509 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.846675 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.846823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.846969 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.847125 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.847279 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.847502 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.847671 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.847826 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.847980 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.848129 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.848275 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.848426 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.848582 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.848743 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.849093 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.849259 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.849415 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.849562 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.849723 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.849907 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.849907 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.850369 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.850517 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.850673 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.850827 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.850981 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.851145 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.851294 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.851464 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.851625 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.851780 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.852031 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.852184 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.852332 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.852477 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.852638 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.852785 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.852938 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.853096 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.853250 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.853412 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.853569 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.853569 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.853854 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.853999 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.854155 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.854311 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.854459 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.854605 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.854758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.854904 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.855065 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.855221 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.855395 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.855564 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.855712 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.855858 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.856012 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.856173 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.856327 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.856483 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.856637 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.856784 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.856930 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.857100 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.857798 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.858027 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.858190 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.858338 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.858495 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.858652 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.858801 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.858956 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.859111 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.859259 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.859555 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.859719 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.859878 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.859878 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.860329 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.860329 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.860639 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.860787 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.860932 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.861078 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.861223 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.861376 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.861532 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.861707 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.861870 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.862043 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.862270 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.862431 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.862589 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.862746 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.862893 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.863038 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.863184 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.863345 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.863521 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.863669 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.863825 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.863983 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.864138 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.864295 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.864442 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.864596 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.864742 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.864888 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.865041 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.865197 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.865344 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.865496 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.865650 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.865797 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.866007 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.866162 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.866309 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.866455 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.866600 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.866752 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.866909 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.867064 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.867210 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.867355 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.867535 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.867535 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.867841 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.868001 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.868156 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.868309 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.868455 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.868608 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.868765 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.868920 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.869068 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.869219 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.869366 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.869511 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.869738 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.869897 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.870056 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.870202 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.870513 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.870686 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.870843 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.871082 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.871245 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.871428 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.871584 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.871740 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.872087 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.872274 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.872510 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.872671 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.872818 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.873086 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.873250 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.873406 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.873618 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.873784 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.873939 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.874099 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.874254 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.874410 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.874556 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.874714 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.874869 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.875061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.875228 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.875422 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.875578 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.875737 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.875894 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.876054 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.876201 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.876347 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.876493 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.876639 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.876812 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.877093 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.877247 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.877402 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.877549 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.877702 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.877862 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.878010 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.878156 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.878156 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.878440 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.878597 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.878759 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.878932 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.879086 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.879238 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.879419 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.879599 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.879761 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.879922 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.879922 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.880220 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.880373 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.880752 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.880924 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.881090 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.881242 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.881394 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.881554 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.881719 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.881872 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.882077 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.882245 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.882408 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.882675 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.882844 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.883006 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.883160 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.883333 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.883333 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.883653 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.883818 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.883818 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.884126 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.884297 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.884459 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.884612 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.884772 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.884772 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.885074 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.885074 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.885074 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.885523 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.885523 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.885523 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.885523 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.885523 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.885523 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.886698 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.886855 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.886855 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.887164 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.887318 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.887318 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.887318 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.887318 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.887318 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.888183 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.888352 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.888514 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.889225 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.889397 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.889565 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.889727 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.889882 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.890149 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.890346 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.890501 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.890684 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.891059 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.891059 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.891059 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.891059 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.891059 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.891059 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.891059 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.892204 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.892204 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.892204 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.892204 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.892204 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.892204 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.892204 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.893400 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.893555 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.893555 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.893855 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.894016 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.894171 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.894324 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.894484 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.894648 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.894814 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.894976 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.894976 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.894976 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.894976 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.894976 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.894976 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.894976 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.894976 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.896234 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.896234 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.896234 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.896234 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.896234 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.896973 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.897126 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.897293 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.897449 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.897601 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.897768 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.897932 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.898137 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.898311 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.898475 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.898636 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.898789 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.898952 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.899113 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.899113 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.899489 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.899652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.899805 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.899965 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.900125 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.900292 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.900447 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.900607 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.900760 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.901159 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.901338 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.901494 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.901494 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.901494 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.901494 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.901494 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.901494 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.901494 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.902516 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.902516 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.902516 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.902973 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.903324 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.903555 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.903890 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.904840 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.904840 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.905360 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.905360 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.905672 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.905943 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.906309 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.906646 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.906966 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.907292 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.907639 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.907957 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.908274 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.908583 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.908904 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.909217 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.909535 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.909845 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.910153 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.910479 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.910806 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.911225 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.911520 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.911703 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.911861 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.912050 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.912223 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.912410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.912580 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.912768 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.913025 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.913221 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.913688 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.913853 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.914018 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.914224 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.914398 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.914562 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.914562 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.914854 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.915008 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.915185 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.915349 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.915624 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.915782 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.915935 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.916088 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.916242 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.916406 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.916570 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.916734 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.916897 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.917059 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.917214 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.917368 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.917520 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.917673 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.917825 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.917988 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.918151 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.918305 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.918477 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.918632 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.918785 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.918956 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.919118 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.919273 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.919480 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.919652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.919816 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.919816 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.920651 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.920651 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.920942 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.921103 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.921493 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.921656 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.921971 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.922344 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.922660 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.923093 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.927468 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.927468 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.927468 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.927468 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.927468 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.927468 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.927468 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.927468 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.928671 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.928671 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.928671 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.928671 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.928671 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.928671 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.928671 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.928671 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.929845 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.929845 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.929845 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.929845 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.929845 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.930652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.930652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.930959 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.931111 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.931333 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.931694 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.931999 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.932320 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.932631 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.932960 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.933285 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.933602 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.933929 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.934487 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.934819 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.936089 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.936089 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.936089 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.936745 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.936878 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.936960 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.937035 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.937315 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.937415 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.937491 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.937607 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.937868 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.937974 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.938166 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.938269 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.938455 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.938564 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.939309 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.939438 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.939531 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.939608 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.939608 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.939752 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.939826 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.940195 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.940295 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.940379 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.940464 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.940712 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.940807 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.940988 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.941081 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.942432 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.943016 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.943101 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.943177 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.943250 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.943322 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.943435 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.943515 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.943588 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.943669 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.943749 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.943832 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.943906 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.943985 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.944058 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.944130 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.944210 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.944297 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.944372 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.944452 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.944532 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.944605 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.944683 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.944769 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.945772 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.945946 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.945946 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.946316 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.946476 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.946642 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.946642 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.946642 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.947019 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.947436 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.949006 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.949006 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.949006 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.949006 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.949006 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.949582 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.951755 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.951900 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.952019 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.952134 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.956439 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.956439 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.956649 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.956739 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.956822 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.956822 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.956971 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.957053 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.957141 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.957224 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.957328 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.957424 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.957506 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.957594 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.957675 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.957675 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.957806 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.957886 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.957958 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.958044 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.958119 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.958190 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.958261 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.958261 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.958408 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.958568 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.958646 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.958717 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.958797 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.958871 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.958943 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.959024 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.959098 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.959178 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.959259 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.959333 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.959492 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.959579 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.959660 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.959741 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.959830 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.959912 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.959995 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.960068 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.960140 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.960212 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.960284 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.960355 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.960436 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.960518 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.960518 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.960791 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.961013 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.961336 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.961662 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.961977 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.962299 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.962611 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.962925 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.963242 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.964049 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.964369 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.964701 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.965017 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.965333 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.965649 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.965962 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.968062 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.968469 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.968575 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.968818 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.968916 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.969217 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.969312 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.969595 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.969926 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.970855 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.971190 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.972118 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.972118 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.972302 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.972393 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.972475 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.972559 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.972633 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.973013 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.973112 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.973200 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.973282 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.973525 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.973628 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.973805 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.974050 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.974160 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.974385 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.974492 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.974715 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.974840 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.975058 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.975159 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.975523 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.975641 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.975721 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.975948 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.976120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.976242 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.976447 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.976547 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.976796 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.976897 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.977163 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.977264 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.977489 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.977590 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.977812 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.978131 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.978565 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.978892 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.979213 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.979555 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.979894 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.980221 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.980541 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.980854 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.981251 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.981506 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.981817 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.982133 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.982578 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.982908 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.983221 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.983699 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.983813 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.984045 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.984154 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.984348 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.984452 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.984642 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.984844 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.984940 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.985118 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.985275 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.985432 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.985545 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.985889 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.985999 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.986078 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.986161 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.986429 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.986590 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.986699 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.986889 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.986991 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.987812 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.987936 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.988174 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.988275 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.988360 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.988436 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.988509 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.988937 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.988937 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.989180 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.989457 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.989770 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.990098 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.990412 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.990737 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:07.992116 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.002473 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.002597 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.002701 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.002795 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.002881 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.002958 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.003033 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.003114 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.003191 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.003274 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.003357 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.003992 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.004073 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.004146 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.004227 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.004313 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.004389 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.004389 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.004538 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.004613 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.004613 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.004613 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.004613 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.004613 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.004613 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.004613 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.004613 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.005713 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.005805 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.005805 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.006006 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.006006 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.006154 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.006228 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.006300 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.006383 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.006383 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.006383 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.006579 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.006654 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.006740 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.006815 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.006895 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.006977 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.007052 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.007124 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.007205 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.007289 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.007388 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.007467 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.007541 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.007629 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.007715 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.007790 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.007871 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.007871 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.008019 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.008102 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.008184 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.010121 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.010231 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.010317 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.010399 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.010399 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.010549 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.010643 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.010719 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.010792 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.010872 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.010955 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.011030 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.011102 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.011183 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.011264 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.011337 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.011448 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.011525 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.011598 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.011696 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.011780 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.011865 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.011865 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.011865 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.011865 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.011865 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.011865 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.012279 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.012355 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.012435 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.012517 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.012598 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.012672 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.012754 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.014880 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.015002 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.015081 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.015154 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.015233 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.015318 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.015429 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.015517 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.015592 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.015665 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.015747 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.015829 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.024070 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.024352 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.024629 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.024835 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.025062 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.025176 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.025462 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.025568 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.025804 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.025907 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.026156 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.026272 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.026489 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.026609 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.027440 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.027562 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.027663 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.027740 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.028238 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.028564 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.028893 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.029854 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.030358 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.030801 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.031176 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.031872 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.032219 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.032550 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.032877 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.033243 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.033626 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.033955 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.034499 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.034846 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.035223 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.035457 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.035755 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.035859 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.036089 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.036206 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.036463 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.036580 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.036802 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.036911 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.037503 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.037631 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.037718 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.037793 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.037874 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.037955 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.038350 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.038456 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.038542 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.038617 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.038758 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.038861 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.039057 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.039156 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.039401 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.039516 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.039731 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.039828 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.040065 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.040371 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.040672 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.040820 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.041019 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.041166 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.041587 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.041780 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.041924 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.042029 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.042239 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.042351 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.042551 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.042660 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.042919 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.043028 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.043261 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.043410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.043632 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.043810 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.043985 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.044308 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.044632 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.045074 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.045353 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.045773 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.046126 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.046485 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.046826 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.047177 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.047634 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.047902 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.048362 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.050001 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.054122 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.054243 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.054335 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.054524 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.054759 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.054905 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.055056 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.055193 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.055193 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.055501 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.055649 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.055802 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.055946 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.056089 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.056089 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.056351 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.056526 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.056746 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.056746 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.057012 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.057154 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.057288 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.057435 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.057585 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.057902 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.058185 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.058333 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.058590 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.058830 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.058830 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.059090 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.059224 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.059357 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.059523 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.059672 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.059672 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.059927 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.059927 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.060177 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.060320 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.060482 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.060696 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.060851 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.060996 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.061140 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.061284 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.061418 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.061551 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.061684 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.061823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.061823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.062123 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.062271 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.062405 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.062578 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.062720 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.062862 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.063011 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.063146 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.063279 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.063449 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.063593 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.063742 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.063876 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.064016 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.064151 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.064290 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.064424 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.064598 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.064760 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.064971 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.065109 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.065242 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.065375 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.065516 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.065651 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.065791 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.065925 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.066065 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.066065 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.066374 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.066508 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.066684 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.066902 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.067045 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.067191 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.067325 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.067475 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.067475 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.067725 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.068030 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.068200 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.068421 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.068573 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.068821 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.069038 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.069184 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.069330 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.069465 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.069596 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.069767 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.069918 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.070062 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.070203 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.070374 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.070374 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.070661 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.070824 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.070971 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.071113 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.071247 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.071506 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.071644 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.071790 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.071942 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.072086 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.072228 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.072363 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.072497 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.072636 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.072780 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.072921 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.073062 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.073196 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.073330 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.073476 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.073613 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.073753 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.073910 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.074050 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.074184 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.074325 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.074466 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.074602 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.074738 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.074878 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.075105 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.075252 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.075404 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.075552 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.075688 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.075821 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.075961 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.076757 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.076968 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.077189 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.077326 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.077471 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.077622 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.077766 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.077901 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.078224 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.078492 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.078634 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.078964 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.079194 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.079342 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.079511 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.079658 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.079794 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.079927 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.080074 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.080208 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.080349 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.080494 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.080643 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.080785 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.080920 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.081061 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.081203 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.081337 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.081479 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.081621 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.081754 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.081889 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.082032 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.082167 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.082314 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.082314 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.082643 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.082777 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.082910 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.083042 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.083042 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.083307 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.083470 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.083635 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.083779 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.083928 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.084072 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.084195 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.084329 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.084461 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.084593 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.084769 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.084932 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.085091 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.085310 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.085448 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.085582 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.085582 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 11:40:08.085895 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.085895 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.085895 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.085895 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.085895 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.085895 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.085895 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.085895 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.086942 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.086942 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.086942 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.086942 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.086942 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.087831 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.087831 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.087831 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.088452 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.088452 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.088824 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.089237 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.089535 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.090095 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.090464 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.090725 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.091057 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.091467 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.092671 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.094253 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.094253 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.094253 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.094759 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.094759 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.095047 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.095352 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.095623 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.095975 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.096308 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.096702 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.096958 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.097300 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.097641 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.097971 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.098289 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.098618 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.098908 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.099215 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.099590 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.099882 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.100175 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.100487 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.100830 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.101141 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.101454 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.101801 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.102119 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.102441 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.102752 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.103189 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.103531 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.103850 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.104164 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.104475 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.104797 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.105110 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.105504 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.105819 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.106133 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.106447 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.106790 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.107132 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.108157 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.108157 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.108379 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.108712 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.109035 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.109368 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.109698 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.110026 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.110348 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.110693 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.111019 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.111443 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.111770 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.112090 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.112413 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.112737 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.113103 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.113437 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.113751 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.114083 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.114408 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.114740 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.115064 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.115472 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.115745 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.116063 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.116385 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.116709 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.117030 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.117348 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.117676 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.118030 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.118366 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.118699 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.119020 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.119355 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.119710 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.120091 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.120415 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.120767 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.121110 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.121436 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.121756 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.122071 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 11:40:08.122348 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 11:40:08.148416 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO dbcounter [None req-3a4fadb6-a29a-4409-b158-cc25ac760b2a None None] Registered counter for database nova_api Jun 17 11:40:08.167599 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_db.sqlalchemy.engines [None req-3a4fadb6-a29a-4409-b158-cc25ac760b2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 11:40:08.175999 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writer thread running {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 11:40:08.190221 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO dbcounter [None req-d8c6dd11-5681-4f5d-b6d2-577680ad0101 None None] Registered counter for database nova_api Jun 17 11:40:08.210725 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_db.sqlalchemy.engines [None req-d8c6dd11-5681-4f5d-b6d2-577680ad0101 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124845) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 11:40:08.219135 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writer thread running {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 11:40:08.236522 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.context [None req-3a4fadb6-a29a-4409-b158-cc25ac760b2a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c323a48d-876b-4d2b-a1cd-4651eaf7de7b(cell1) {{(pid=124844) load_cells /opt/stack/nova/nova/context.py:464}} Jun 17 11:40:08.240909 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3a4fadb6-a29a-4409-b158-cc25ac760b2a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:40:08.242911 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3a4fadb6-a29a-4409-b158-cc25ac760b2a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:40:08.243343 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3a4fadb6-a29a-4409-b158-cc25ac760b2a None None] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:40:08.245568 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3a4fadb6-a29a-4409-b158-cc25ac760b2a None None] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:40:08.247835 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO dbcounter [None req-3a4fadb6-a29a-4409-b158-cc25ac760b2a None None] Registered counter for database nova_cell0 Jun 17 11:40:08.252638 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO dbcounter [None req-3a4fadb6-a29a-4409-b158-cc25ac760b2a None None] Registered counter for database nova_cell1 Jun 17 11:40:08.260643 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_db.sqlalchemy.engines [None req-3a4fadb6-a29a-4409-b158-cc25ac760b2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 11:40:08.262188 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_db.sqlalchemy.engines [None req-3a4fadb6-a29a-4409-b158-cc25ac760b2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 11:40:08.269294 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writer thread running {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 11:40:08.270651 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writer thread running {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 11:40:08.282828 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.context [None req-d8c6dd11-5681-4f5d-b6d2-577680ad0101 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c323a48d-876b-4d2b-a1cd-4651eaf7de7b(cell1) {{(pid=124845) load_cells /opt/stack/nova/nova/context.py:464}} Jun 17 11:40:08.287738 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d8c6dd11-5681-4f5d-b6d2-577680ad0101 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:40:08.289366 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d8c6dd11-5681-4f5d-b6d2-577680ad0101 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:40:08.290205 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d8c6dd11-5681-4f5d-b6d2-577680ad0101 None None] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:40:08.292790 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d8c6dd11-5681-4f5d-b6d2-577680ad0101 None None] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:40:08.295563 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO dbcounter [None req-d8c6dd11-5681-4f5d-b6d2-577680ad0101 None None] Registered counter for database nova_cell0 Jun 17 11:40:08.299770 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO dbcounter [None req-d8c6dd11-5681-4f5d-b6d2-577680ad0101 None None] Registered counter for database nova_cell1 Jun 17 11:40:08.306997 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_db.sqlalchemy.engines [None req-d8c6dd11-5681-4f5d-b6d2-577680ad0101 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124845) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 11:40:08.308888 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_db.sqlalchemy.engines [None req-d8c6dd11-5681-4f5d-b6d2-577680ad0101 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124845) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 11:40:08.315270 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writer thread running {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 11:40:08.317425 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writer thread running {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 11:40:08.425151 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO dbcounter [None req-3a4fadb6-a29a-4409-b158-cc25ac760b2a None None] Registered counter for database nova_cell0 Jun 17 11:40:08.432058 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_db.sqlalchemy.engines [None req-3a4fadb6-a29a-4409-b158-cc25ac760b2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 11:40:08.439850 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writer thread running {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 11:40:08.473974 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO dbcounter [None req-d8c6dd11-5681-4f5d-b6d2-577680ad0101 None None] Registered counter for database nova_cell0 Jun 17 11:40:08.480747 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_db.sqlalchemy.engines [None req-d8c6dd11-5681-4f5d-b6d2-577680ad0101 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124845) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 11:40:08.486367 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writer thread running {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 11:40:08.765757 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: WARNING keystonemiddleware.auth_token [None req-3a4fadb6-a29a-4409-b158-cc25ac760b2a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 11:40:08.773139 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: WARNING keystonemiddleware.auth_token [None req-3a4fadb6-a29a-4409-b158-cc25ac760b2a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 11:40:08.816815 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: WARNING keystonemiddleware.auth_token [None req-d8c6dd11-5681-4f5d-b6d2-577680ad0101 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 11:40:08.824234 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: WARNING keystonemiddleware.auth_token [None req-d8c6dd11-5681-4f5d-b6d2-577680ad0101 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 11:40:09.122310 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: WARNING keystonemiddleware.auth_token [None req-3a4fadb6-a29a-4409-b158-cc25ac760b2a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 11:40:09.128857 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: WARNING keystonemiddleware.auth_token [None req-3a4fadb6-a29a-4409-b158-cc25ac760b2a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 11:40:09.134178 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c910a729c0 pid: 124844 (default app) Jun 17 11:40:09.176507 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: WARNING keystonemiddleware.auth_token [None req-d8c6dd11-5681-4f5d-b6d2-577680ad0101 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 11:40:09.182503 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: WARNING keystonemiddleware.auth_token [None req-d8c6dd11-5681-4f5d-b6d2-577680ad0101 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 11:40:09.188395 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c910a729c0 pid: 124845 (default app) Jun 17 11:40:50.756450 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=3 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:40:50.758215 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=3 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:40:50.759354 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=3 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:40:50.760307 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=3 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:40:51.964677 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-127f7e97-0a9f-493a-9b4d-3ebc87e6630a tempest-VolumesGetTestJSON-983702923 tempest-VolumesGetTestJSON-983702923-project] Action: 'create', calling method: .version_select at 0x7f9c788388b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-982597433", "metadata": {"Type": "work"}}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:40:55.339415 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-127f7e97-0a9f-493a-9b4d-3ebc87e6630a tempest-VolumesGetTestJSON-983702923 tempest-VolumesGetTestJSON-983702923-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.594864 Jun 17 11:40:55.343915 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 1/1] 10.222.0.45 () {60 vars in 1155 bytes} [Fri Jun 17 11:40:50 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4602 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 17 11:40:55.817479 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6a0135c2-24e8-459f-ae69-7c7671e3c0a9 tempest-VolumesGetTestJSON-983702923 tempest-VolumesGetTestJSON-983702923-project] Calling method '.version_select at 0x7f9c7923ea60>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:40:55.852848 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=3 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:40:55.852848 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=3 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:40:55.852848 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=3 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:40:55.852848 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=3 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:40:56.280699 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-6a0135c2-24e8-459f-ae69-7c7671e3c0a9 tempest-VolumesGetTestJSON-983702923 tempest-VolumesGetTestJSON-983702923-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/c28c5eb8-7b4a-492a-9064-e3f6bcced975" status: 200 len: 352 microversion: 2.1 time: 0.932103 Jun 17 11:40:56.283823 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 1/2] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jun 17 11:40:55 2022] GET /compute/v2.1/os-volumes/c28c5eb8-7b4a-492a-9064-e3f6bcced975 => generated 352 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:40:57.298750 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-19581f0a-129e-440f-9f81-e0cd415ae373 tempest-VolumesGetTestJSON-983702923 tempest-VolumesGetTestJSON-983702923-project] Calling method '.version_select at 0x7f9c78701700>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:40:57.495407 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-19581f0a-129e-440f-9f81-e0cd415ae373 tempest-VolumesGetTestJSON-983702923 tempest-VolumesGetTestJSON-983702923-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/c28c5eb8-7b4a-492a-9064-e3f6bcced975" status: 200 len: 353 microversion: 2.1 time: 0.197432 Jun 17 11:40:57.495407 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 2/3] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jun 17 11:40:57 2022] GET /compute/v2.1/os-volumes/c28c5eb8-7b4a-492a-9064-e3f6bcced975 => generated 353 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:40:57.507247 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-1ecfd8fc-d60d-4630-a2ae-d5c6a51481ba tempest-VolumesGetTestJSON-983702923 tempest-VolumesGetTestJSON-983702923-project] Calling method '.version_select at 0x7f9c78743940>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:40:57.773279 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-1ecfd8fc-d60d-4630-a2ae-d5c6a51481ba tempest-VolumesGetTestJSON-983702923 tempest-VolumesGetTestJSON-983702923-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/c28c5eb8-7b4a-492a-9064-e3f6bcced975" status: 200 len: 353 microversion: 2.1 time: 0.264570 Jun 17 11:40:57.773279 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 2/4] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jun 17 11:40:57 2022] GET /compute/v2.1/os-volumes/c28c5eb8-7b4a-492a-9064-e3f6bcced975 => generated 353 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:40:57.783696 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-0b1849e8-ab6e-4b51-a95d-df02e6dc9381 tempest-VolumesGetTestJSON-983702923 tempest-VolumesGetTestJSON-983702923-project] Calling method '.version_select at 0x7f9c78701820>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:40:58.602920 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-0b1849e8-ab6e-4b51-a95d-df02e6dc9381 tempest-VolumesGetTestJSON-983702923 tempest-VolumesGetTestJSON-983702923-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/c28c5eb8-7b4a-492a-9064-e3f6bcced975" status: 202 len: 0 microversion: 2.1 time: 0.813846 Jun 17 11:40:58.602920 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 3/5] 10.222.0.45 () {58 vars in 1247 bytes} [Fri Jun 17 11:40:57 2022] DELETE /compute/v2.1/os-volumes/c28c5eb8-7b4a-492a-9064-e3f6bcced975 => generated 0 bytes in 815 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 11:40:58.605323 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a184d760-4e5b-4eda-81c3-980088a81286 tempest-VolumesGetTestJSON-983702923 tempest-VolumesGetTestJSON-983702923-project] Calling method '.version_select at 0x7f9c787431f0>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:40:58.959231 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a184d760-4e5b-4eda-81c3-980088a81286 tempest-VolumesGetTestJSON-983702923 tempest-VolumesGetTestJSON-983702923-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/c28c5eb8-7b4a-492a-9064-e3f6bcced975" status: 200 len: 352 microversion: 2.1 time: 0.360451 Jun 17 11:40:58.960117 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 3/6] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jun 17 11:40:58 2022] GET /compute/v2.1/os-volumes/c28c5eb8-7b4a-492a-9064-e3f6bcced975 => generated 352 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:40:59.986055 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-47be6223-cf92-4a7b-b5aa-d86e7a41c49e tempest-VolumesGetTestJSON-983702923 tempest-VolumesGetTestJSON-983702923-project] Calling method '.version_select at 0x7f9c78701e50>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:00.072133 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-47be6223-cf92-4a7b-b5aa-d86e7a41c49e tempest-VolumesGetTestJSON-983702923 tempest-VolumesGetTestJSON-983702923-project] HTTP exception thrown: Volume c28c5eb8-7b4a-492a-9064-e3f6bcced975 could not be found. Jun 17 11:41:00.077757 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-47be6223-cf92-4a7b-b5aa-d86e7a41c49e tempest-VolumesGetTestJSON-983702923 tempest-VolumesGetTestJSON-983702923-project] Request method failure captured: Jun 17 11:41:00.077757 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: request: GET /compute/v2.1/os-volumes/c28c5eb8-7b4a-492a-9064-e3f6bcced975 HTTP/1.1 Jun 17 11:41:00.077757 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept: application/json Jun 17 11:41:00.077757 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jun 17 11:41:00.077757 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Connection: close Jun 17 11:41:00.077757 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jun 17 11:41:00.077757 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jun 17 11:41:00.077757 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Host: 10.222.0.45 Jun 17 11:41:00.077757 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jun 17 11:41:00.077757 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jun 17 11:41:00.077757 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABirGhCe1Sw19mi_qJW19rHfXo-eAbQF0eb8_8R1v0-MxdmKd5_MZHW2SL2rSvxqvvKBVmdfxuPs7jveMUBSy2jfKC9_MAs-bT9YDQC6NgVJWLxHQXc5MfnEKmAJpFnM8cgPkciAtTdOVk1F8k-2szKY2tlSyCJhgUrdCzGJbU2CWVdeyI Jun 17 11:41:00.077757 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jun 17 11:41:00.077757 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jun 17 11:41:00.077757 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jun 17 11:41:00.077757 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jun 17 11:41:00.077757 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jun 17 11:41:00.077757 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jun 17 11:41:00.077757 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Id: eaf3f61f112c41b0955767dd9333c793 Jun 17 11:41:00.077757 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-VolumesGetTestJSON-983702923 Jun 17 11:41:00.077757 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Role: member,reader Jun 17 11:41:00.077757 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Roles: member,reader Jun 17 11:41:00.078927 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/eaf3f61f112c41b0955767dd9333c793"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_eaf3f61f112c41b0955767dd9333c793", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eaf3f61f112c41b0955767dd9333c793"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eaf3f61f112c41b0955767dd9333c793"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:41:00.078927 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-VolumesGetTestJSON-983702923 Jun 17 11:41:00.078927 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Id: eaf3f61f112c41b0955767dd9333c793 Jun 17 11:41:00.078927 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-VolumesGetTestJSON-983702923 Jun 17 11:41:00.078927 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User: tempest-VolumesGetTestJSON-983702923-project Jun 17 11:41:00.078927 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jun 17 11:41:00.078927 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jun 17 11:41:00.078927 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Id: e5c69bb5f4bb439b8f7709fc3a3f5301 Jun 17 11:41:00.078927 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-VolumesGetTestJSON-983702923-project Jun 17 11:41:00.078927 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: method: Jun 17 11:41:00.078927 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: exception: Volume c28c5eb8-7b4a-492a-9064-e3f6bcced975 could not be found. Jun 17 11:41:00.078927 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: action_args: {'id': 'c28c5eb8-7b4a-492a-9064-e3f6bcced975'} Jun 17 11:41:00.078927 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:41:00.079650 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:41:00.079650 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 11:41:00.079650 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 11:41:00.079650 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 11:41:00.079650 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 11:41:00.079650 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 11:41:00.079650 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 11:41:00.079650 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 11:41:00.079650 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 11:41:00.079650 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 11:41:00.079650 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 11:41:00.079650 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 11:41:00.079650 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 11:41:00.079650 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 11:41:00.079650 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 11:41:00.079650 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c28c5eb8-7b4a-492a-9064-e3f6bcced975 could not be found. (HTTP 404) (Request-ID: req-d357681b-e55b-4432-88bf-c36220dcb498) Jun 17 11:41:00.079650 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:41:00.079650 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:41:00.079650 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:41:00.080740 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:41:00.080740 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 17 11:41:00.080740 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 17 11:41:00.080740 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 11:41:00.080740 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 11:41:00.080740 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 11:41:00.080740 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 11:41:00.080740 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 11:41:00.080740 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 11:41:00.080740 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 11:41:00.080740 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 11:41:00.080740 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 11:41:00.080740 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 11:41:00.080740 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 11:41:00.080740 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 11:41:00.080740 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 11:41:00.080740 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 11:41:00.080740 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 11:41:00.080740 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 11:41:00.082968 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 11:41:00.082968 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 11:41:00.082968 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 11:41:00.082968 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 11:41:00.082968 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c28c5eb8-7b4a-492a-9064-e3f6bcced975 could not be found. Jun 17 11:41:00.082968 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:41:00.082968 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:41:00.082968 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:41:00.082968 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:41:00.082968 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:41:00.082968 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:41:00.082968 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:41:00.082968 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:41:00.082968 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 11:41:00.082968 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 11:41:00.082968 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:41:00.082968 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:41:00.082968 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 17 11:41:00.082968 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:41:00.084057 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c28c5eb8-7b4a-492a-9064-e3f6bcced975 could not be found. Jun 17 11:41:00.084057 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:41:00.084057 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:41:00.084057 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:41:00.084057 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:41:00.084057 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:41:00.084057 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:41:00.084057 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:41:00.084057 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:41:00.084057 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c28c5eb8-7b4a-492a-9064-e3f6bcced975 could not be found. Jun 17 11:41:00.084057 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:41:00.084057 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-47be6223-cf92-4a7b-b5aa-d86e7a41c49e tempest-VolumesGetTestJSON-983702923 tempest-VolumesGetTestJSON-983702923-project] Returning 404 to user: Volume c28c5eb8-7b4a-492a-9064-e3f6bcced975 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:41:00.084057 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-47be6223-cf92-4a7b-b5aa-d86e7a41c49e tempest-VolumesGetTestJSON-983702923 tempest-VolumesGetTestJSON-983702923-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/c28c5eb8-7b4a-492a-9064-e3f6bcced975" status: 404 len: 109 microversion: 2.1 time: 0.102376 Jun 17 11:41:00.084057 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 4/7] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jun 17 11:40:59 2022] GET /compute/v2.1/os-volumes/c28c5eb8-7b4a-492a-9064-e3f6bcced975 => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:41:05.036674 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a4abd35e-682c-4e6f-8f79-25641be50e4e tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Action: 'create', calling method: .version_select at 0x7f9c787070d0>, body: {"keypair": {"name": "tempest-keypair-1770682285", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIsT5D9n2ot2854athwd3O2qsFvw1yBVpuv1B5jM8qfO8fojDe3eHwXf8MKHhGBcfsdRmS41P5Fqm75zELMNCCjhfrOm48fEbo0QVSVhUXms3j8Hi9Bd3NHTY3Zp5RmbA=="}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:41:05.146694 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-a4abd35e-682c-4e6f-8f79-25641be50e4e tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Getting quotas for project b35e2c02ed78431fbbc93d3da1a7caba. Resources: {'key_pairs'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 11:41:05.177704 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-a4abd35e-682c-4e6f-8f79-25641be50e4e tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Getting quotas for user f78027ac3a2c463fbe14da8443a09761 and project b35e2c02ed78431fbbc93d3da1a7caba. Resources: {'key_pairs'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 11:41:05.436163 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a4abd35e-682c-4e6f-8f79-25641be50e4e tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.231014 Jun 17 11:41:05.442288 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 4/8] 10.222.0.45 () {60 vars in 1158 bytes} [Fri Jun 17 11:41:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:41:05.977322 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ffa51437-b8a6-46e8-879c-937fa053b8f8 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1857385417", "imageRef": "272eb2b7-ddf0-433f-8be8-cdc13c01be77", "flavorRef": "452", "networks": [{"uuid": "cbd2698b-6feb-4535-a9e0-4b42209dc23d"}]}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:41:06.189404 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.network.neutron [None req-ffa51437-b8a6-46e8-879c-937fa053b8f8 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] validate_networks() for [('cbd2698b-6feb-4535-a9e0-4b42209dc23d', None, None, None, None, None)] {{(pid=124844) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 11:41:09.010131 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-ffa51437-b8a6-46e8-879c-937fa053b8f8 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Flavor limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 11:41:09.010748 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-ffa51437-b8a6-46e8-879c-937fa053b8f8 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Image limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 11:41:09.011023 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-ffa51437-b8a6-46e8-879c-937fa053b8f8 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Flavor pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 11:41:09.011475 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-ffa51437-b8a6-46e8-879c-937fa053b8f8 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Image pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 11:41:09.011896 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-ffa51437-b8a6-46e8-879c-937fa053b8f8 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 11:41:09.037619 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ffa51437-b8a6-46e8-879c-937fa053b8f8 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:09.038566 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ffa51437-b8a6-46e8-879c-937fa053b8f8 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:09.049870 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ffa51437-b8a6-46e8-879c-937fa053b8f8 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:09.050493 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ffa51437-b8a6-46e8-879c-937fa053b8f8 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:09.091198 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-ffa51437-b8a6-46e8-879c-937fa053b8f8 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Getting quotas for project b9ebd69a2ffc492eae05aaf62e2d8ee2. Resources: {'instances', 'ram', 'cores'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 11:41:09.100064 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-ffa51437-b8a6-46e8-879c-937fa053b8f8 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Getting quotas for user 14d78520e9c2483c94050fc91d9e4eca and project b9ebd69a2ffc492eae05aaf62e2d8ee2. Resources: {'instances', 'ram', 'cores'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 11:41:09.115178 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ffa51437-b8a6-46e8-879c-937fa053b8f8 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Going to run 1 instances... {{(pid=124844) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 11:41:09.118143 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ffa51437-b8a6-46e8-879c-937fa053b8f8 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] [instance: 8decdd22-7413-438f-94d0-5c3238a2072b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='272eb2b7-ddf0-433f-8be8-cdc13c01be77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 11:41:09.359279 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ffa51437-b8a6-46e8-879c-937fa053b8f8 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.665141 Jun 17 11:41:09.360707 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 5/9] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 17 11:41:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 3668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 11:41:09.374256 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-3600cfa7-d230-4046-aba7-70dc1eb31913 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:09.376985 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-3600cfa7-d230-4046-aba7-70dc1eb31913 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] [instance: 8decdd22-7413-438f-94d0-5c3238a2072b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:09.878789 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-3600cfa7-d230-4046-aba7-70dc1eb31913 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d78520e9c2483c94050fc91d9e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebd69a2ffc492eae05aaf62e2d8ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:09.922131 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-3600cfa7-d230-4046-aba7-70dc1eb31913 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] 10.222.0.45 "GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b" status: 200 len: 1215 microversion: 2.1 time: 0.554002 Jun 17 11:41:09.927515 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 5/10] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:09 2022] GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b => generated 1215 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:10.945728 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f7afa462-f6d5-4996-880f-920fa28c0f23 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:10.947109 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f7afa462-f6d5-4996-880f-920fa28c0f23 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] [instance: 8decdd22-7413-438f-94d0-5c3238a2072b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:11.072554 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f7afa462-f6d5-4996-880f-920fa28c0f23 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d78520e9c2483c94050fc91d9e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebd69a2ffc492eae05aaf62e2d8ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:11.088644 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f7afa462-f6d5-4996-880f-920fa28c0f23 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] 10.222.0.45 "GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b" status: 200 len: 1215 microversion: 2.1 time: 0.147916 Jun 17 11:41:11.091892 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 6/11] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:10 2022] GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b => generated 1215 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:12.091293 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-833f4513-ad47-4d5a-8da6-ad226c13d7b2 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1463365419", "imageRef": "272eb2b7-ddf0-433f-8be8-cdc13c01be77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c868a535-9c12-4f90-862a-6c3a44470c58"}], "security_groups": [{"name": "tempest-securitygroup--1249836391"}], "key_name": "tempest-keypair-1770682285", "user_data": "}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:41:12.108711 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d3ce70ee-4fb9-468d-ae48-6fa8271bf2e3 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:12.109476 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d3ce70ee-4fb9-468d-ae48-6fa8271bf2e3 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] [instance: 8decdd22-7413-438f-94d0-5c3238a2072b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:12.301130 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d3ce70ee-4fb9-468d-ae48-6fa8271bf2e3 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d78520e9c2483c94050fc91d9e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebd69a2ffc492eae05aaf62e2d8ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:12.308097 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d3ce70ee-4fb9-468d-ae48-6fa8271bf2e3 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] 10.222.0.45 "GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b" status: 200 len: 1215 microversion: 2.1 time: 0.200295 Jun 17 11:41:12.309030 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 7/12] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:12 2022] GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b => generated 1215 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:41:12.560712 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.network.neutron [None req-833f4513-ad47-4d5a-8da6-ad226c13d7b2 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] validate_networks() for [('c868a535-9c12-4f90-862a-6c3a44470c58', None, None, None, None, None)] {{(pid=124845) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 11:41:13.326642 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2bd1c030-bbca-45fd-a6a1-6cb014d969c8 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:13.327297 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-2bd1c030-bbca-45fd-a6a1-6cb014d969c8 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] [instance: 8decdd22-7413-438f-94d0-5c3238a2072b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:13.346784 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2bd1c030-bbca-45fd-a6a1-6cb014d969c8 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:13.349434 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2bd1c030-bbca-45fd-a6a1-6cb014d969c8 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:13.353580 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2bd1c030-bbca-45fd-a6a1-6cb014d969c8 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:13.354421 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2bd1c030-bbca-45fd-a6a1-6cb014d969c8 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:13.792736 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2bd1c030-bbca-45fd-a6a1-6cb014d969c8 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d78520e9c2483c94050fc91d9e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebd69a2ffc492eae05aaf62e2d8ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:13.807203 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2bd1c030-bbca-45fd-a6a1-6cb014d969c8 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] 10.222.0.45 "GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b" status: 200 len: 1219 microversion: 2.1 time: 0.485434 Jun 17 11:41:13.820064 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 8/13] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:13 2022] GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b => generated 1219 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:14.491781 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-85a4c053-2932-4e22-be9f-dd8844c604a8 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-563066662", "imageRef": "272eb2b7-ddf0-433f-8be8-cdc13c01be77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:41:14.634008 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.network.neutron [None req-85a4c053-2932-4e22-be9f-dd8844c604a8 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] validate_networks() for [('e4c276b9-0ec2-4a2e-bb49-d12a5faa15dc', None, None, None, None, None)] {{(pid=124844) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 11:41:15.368910 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-833f4513-ad47-4d5a-8da6-ad226c13d7b2 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Flavor limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 11:41:15.369790 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-833f4513-ad47-4d5a-8da6-ad226c13d7b2 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Image limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 11:41:15.370491 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-833f4513-ad47-4d5a-8da6-ad226c13d7b2 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Flavor pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 11:41:15.370914 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-833f4513-ad47-4d5a-8da6-ad226c13d7b2 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Image pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 11:41:15.371324 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-833f4513-ad47-4d5a-8da6-ad226c13d7b2 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 11:41:15.392875 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-833f4513-ad47-4d5a-8da6-ad226c13d7b2 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:15.421863 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-833f4513-ad47-4d5a-8da6-ad226c13d7b2 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:15.427505 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-833f4513-ad47-4d5a-8da6-ad226c13d7b2 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:15.428749 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-833f4513-ad47-4d5a-8da6-ad226c13d7b2 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:15.473297 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-833f4513-ad47-4d5a-8da6-ad226c13d7b2 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Getting quotas for project b35e2c02ed78431fbbc93d3da1a7caba. Resources: {'instances', 'ram', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 11:41:15.480234 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-833f4513-ad47-4d5a-8da6-ad226c13d7b2 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Getting quotas for user f78027ac3a2c463fbe14da8443a09761 and project b35e2c02ed78431fbbc93d3da1a7caba. Resources: {'instances', 'ram', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 11:41:15.505743 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-833f4513-ad47-4d5a-8da6-ad226c13d7b2 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Going to run 1 instances... {{(pid=124845) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 11:41:15.508228 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-833f4513-ad47-4d5a-8da6-ad226c13d7b2 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='272eb2b7-ddf0-433f-8be8-cdc13c01be77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 11:41:15.683495 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-833f4513-ad47-4d5a-8da6-ad226c13d7b2 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.597146 Jun 17 11:41:15.684730 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 6/14] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 17 11:41:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 3599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 11:41:15.690645 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-842855f3-924e-4a7e-9a55-f937a0c89d44 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:15.695447 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-842855f3-924e-4a7e-9a55-f937a0c89d44 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] [instance: 8decdd22-7413-438f-94d0-5c3238a2072b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:15.707630 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-842855f3-924e-4a7e-9a55-f937a0c89d44 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:15.720946 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-842855f3-924e-4a7e-9a55-f937a0c89d44 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:15.722654 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-842855f3-924e-4a7e-9a55-f937a0c89d44 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:15.723121 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-842855f3-924e-4a7e-9a55-f937a0c89d44 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:16.056831 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-842855f3-924e-4a7e-9a55-f937a0c89d44 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d78520e9c2483c94050fc91d9e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebd69a2ffc492eae05aaf62e2d8ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:16.091382 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-842855f3-924e-4a7e-9a55-f937a0c89d44 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] 10.222.0.45 "GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b" status: 200 len: 1285 microversion: 2.1 time: 0.405071 Jun 17 11:41:16.092112 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 7/15] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:15 2022] GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b => generated 1285 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:16.116833 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-5685444d-7b05-4c8e-974e-7c9d37c2757a tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:16.118526 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-5685444d-7b05-4c8e-974e-7c9d37c2757a tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:16.298784 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5685444d-7b05-4c8e-974e-7c9d37c2757a tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:16.315193 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-5685444d-7b05-4c8e-974e-7c9d37c2757a tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1238 microversion: 2.1 time: 0.204347 Jun 17 11:41:16.315193 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 8/16] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:16 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1238 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:16.583196 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-85a4c053-2932-4e22-be9f-dd8844c604a8 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Flavor limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 11:41:16.584663 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-85a4c053-2932-4e22-be9f-dd8844c604a8 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Image limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 11:41:16.585335 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-85a4c053-2932-4e22-be9f-dd8844c604a8 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Flavor pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 11:41:16.585894 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-85a4c053-2932-4e22-be9f-dd8844c604a8 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Image pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 11:41:16.586453 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-85a4c053-2932-4e22-be9f-dd8844c604a8 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 11:41:16.622175 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-85a4c053-2932-4e22-be9f-dd8844c604a8 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:16.623682 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-85a4c053-2932-4e22-be9f-dd8844c604a8 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:16.624561 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-85a4c053-2932-4e22-be9f-dd8844c604a8 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:16.624942 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-85a4c053-2932-4e22-be9f-dd8844c604a8 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:16.696567 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a5ea458c-2ae5-427d-b10e-1e0f3fae7549 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Action: 'create', calling method: .version_select at 0x7f9c76ca7ca0>, body: {"keypair": {"name": "tempest-keypair-801864130", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQpaarxS/JMAajqPHLUaJr4hv9Swg0oiUvzEk2Wu6wcLerwZ+1loA75aO+LX+KMimVzbMImNBTa55GSyIdfyr2W1JqIO2eGYiQsenlROtLq9eWKlpwuPcEme0qBODePGA=="}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:41:16.716525 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-85a4c053-2932-4e22-be9f-dd8844c604a8 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Getting quotas for project e38262ed2ed84004a6e01d423cadcae4. Resources: {'instances', 'ram', 'cores'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 11:41:16.717886 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-a5ea458c-2ae5-427d-b10e-1e0f3fae7549 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Getting quotas for project c58cf63264414f30a98161f6027daad0. Resources: {'key_pairs'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 11:41:16.722755 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-a5ea458c-2ae5-427d-b10e-1e0f3fae7549 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Getting quotas for user 2e58eacbbb9e41fdbbb13f5b39be782a and project c58cf63264414f30a98161f6027daad0. Resources: {'key_pairs'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 11:41:16.728635 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-85a4c053-2932-4e22-be9f-dd8844c604a8 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Getting quotas for user a79957b3f2e94f31bd2cb82290ed0962 and project e38262ed2ed84004a6e01d423cadcae4. Resources: {'instances', 'ram', 'cores'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 11:41:16.750921 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-85a4c053-2932-4e22-be9f-dd8844c604a8 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Going to run 1 instances... {{(pid=124844) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 11:41:16.753363 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-85a4c053-2932-4e22-be9f-dd8844c604a8 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='272eb2b7-ddf0-433f-8be8-cdc13c01be77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 11:41:16.818570 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a5ea458c-2ae5-427d-b10e-1e0f3fae7549 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.500006 Jun 17 11:41:16.820184 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 9/17] 10.222.0.45 () {60 vars in 1158 bytes} [Fri Jun 17 11:41:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:41:16.936499 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-85a4c053-2932-4e22-be9f-dd8844c604a8 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.115174 Jun 17 11:41:16.940850 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 9/18] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 17 11:41:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 3120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 11:41:16.952243 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b05a635a-d4e0-4b4d-b3c4-729991245b1a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:16.954757 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b05a635a-d4e0-4b4d-b3c4-729991245b1a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:17.256975 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b05a635a-d4e0-4b4d-b3c4-729991245b1a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:17.275927 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b05a635a-d4e0-4b4d-b3c4-729991245b1a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74" status: 200 len: 1221 microversion: 2.1 time: 0.319326 Jun 17 11:41:17.291927 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 10/19] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:16 2022] GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74 => generated 1221 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:41:17.308621 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-916aad74-5129-40ff-9874-0708b1c417ea tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:17.313685 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-916aad74-5129-40ff-9874-0708b1c417ea tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] [instance: 8decdd22-7413-438f-94d0-5c3238a2072b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:17.332778 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-916aad74-5129-40ff-9874-0708b1c417ea tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:17.336932 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-916aad74-5129-40ff-9874-0708b1c417ea tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:17.340096 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-916aad74-5129-40ff-9874-0708b1c417ea tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:17.340561 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-916aad74-5129-40ff-9874-0708b1c417ea tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:17.398951 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0a692cfe-caf1-4fc5-a7c3-6a778e8eda24 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Action: 'create', calling method: .version_select at 0x7f9c76d08dc0>, body: {"keypair": {"name": "tempest-keypair-1601128479", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKIMGeWEBVc3oOziurJjBJrE0s8n54nPzGrJzHG8P6kCHa4f0jBkzUmuaTgeA1NXoAHZO6a4fA7amO1vSsLmQQ7Nog8iMwt/Yd6KAvfyaOOJHcWLvNARLnZnmRvisDuRA=="}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:41:17.457614 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-0a692cfe-caf1-4fc5-a7c3-6a778e8eda24 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Getting quotas for project bc8dc1335e284eee8cca45d5720d5f16. Resources: {'key_pairs'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 11:41:17.469418 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-0a692cfe-caf1-4fc5-a7c3-6a778e8eda24 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Getting quotas for user d817bad669fc4d6f829bf6eb57773b23 and project bc8dc1335e284eee8cca45d5720d5f16. Resources: {'key_pairs'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 11:41:17.623866 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-916aad74-5129-40ff-9874-0708b1c417ea tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d78520e9c2483c94050fc91d9e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebd69a2ffc492eae05aaf62e2d8ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:17.653742 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-916aad74-5129-40ff-9874-0708b1c417ea tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] 10.222.0.45 "GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b" status: 200 len: 1273 microversion: 2.1 time: 0.360576 Jun 17 11:41:17.657855 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 11/20] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:17 2022] GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b => generated 1273 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:17.683398 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d40283d8-1977-47c8-818b-87f3e11f02f2 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:17.683398 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d40283d8-1977-47c8-818b-87f3e11f02f2 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:17.796976 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0a692cfe-caf1-4fc5-a7c3-6a778e8eda24 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.972989 Jun 17 11:41:17.798731 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 10/21] 10.222.0.45 () {62 vars in 1199 bytes} [Fri Jun 17 11:41:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 977 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 17 11:41:17.804261 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2e92279b-6c3c-44fc-80fb-c0892902cd6d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-261310767", "imageRef": "272eb2b7-ddf0-433f-8be8-cdc13c01be77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:41:17.878650 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d40283d8-1977-47c8-818b-87f3e11f02f2 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:17.889224 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d40283d8-1977-47c8-818b-87f3e11f02f2 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1238 microversion: 2.1 time: 0.225679 Jun 17 11:41:17.890224 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 12/22] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:17 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1238 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:17.915974 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.network.neutron [None req-2e92279b-6c3c-44fc-80fb-c0892902cd6d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] validate_networks() for [('e4c276b9-0ec2-4a2e-bb49-d12a5faa15dc', None, None, None, None, None)] {{(pid=124845) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 11:41:18.674526 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-26f0f184-8683-41ac-b866-6cad6be2d808 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:18.675838 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-26f0f184-8683-41ac-b866-6cad6be2d808 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] [instance: 8decdd22-7413-438f-94d0-5c3238a2072b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:18.699142 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-26f0f184-8683-41ac-b866-6cad6be2d808 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:18.705008 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-26f0f184-8683-41ac-b866-6cad6be2d808 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:18.710697 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-26f0f184-8683-41ac-b866-6cad6be2d808 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:18.711177 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-26f0f184-8683-41ac-b866-6cad6be2d808 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:19.682046 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-26f0f184-8683-41ac-b866-6cad6be2d808 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d78520e9c2483c94050fc91d9e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebd69a2ffc492eae05aaf62e2d8ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:19.714563 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-26f0f184-8683-41ac-b866-6cad6be2d808 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] 10.222.0.45 "GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b" status: 200 len: 1315 microversion: 2.1 time: 1.043904 Jun 17 11:41:19.720953 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 13/23] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:18 2022] GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b => generated 1315 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:19.747153 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2e902faa-464b-4fea-a9e7-025724d4f7f5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:19.747815 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-2e902faa-464b-4fea-a9e7-025724d4f7f5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:19.784914 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2e902faa-464b-4fea-a9e7-025724d4f7f5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:19.785593 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2e902faa-464b-4fea-a9e7-025724d4f7f5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:19.790730 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2e902faa-464b-4fea-a9e7-025724d4f7f5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:19.800600 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2e902faa-464b-4fea-a9e7-025724d4f7f5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:20.092405 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-2e92279b-6c3c-44fc-80fb-c0892902cd6d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Flavor limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 11:41:20.093036 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-2e92279b-6c3c-44fc-80fb-c0892902cd6d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Image limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 11:41:20.093478 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-2e92279b-6c3c-44fc-80fb-c0892902cd6d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Flavor pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 11:41:20.094067 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-2e92279b-6c3c-44fc-80fb-c0892902cd6d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Image pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 11:41:20.094505 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-2e92279b-6c3c-44fc-80fb-c0892902cd6d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 11:41:20.118409 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2e92279b-6c3c-44fc-80fb-c0892902cd6d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:20.118873 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2e92279b-6c3c-44fc-80fb-c0892902cd6d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:20.125469 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2e92279b-6c3c-44fc-80fb-c0892902cd6d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:20.126370 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2e92279b-6c3c-44fc-80fb-c0892902cd6d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:20.396030 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-2e92279b-6c3c-44fc-80fb-c0892902cd6d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Getting quotas for project e38262ed2ed84004a6e01d423cadcae4. Resources: {'instances', 'ram', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 11:41:20.396030 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-2e92279b-6c3c-44fc-80fb-c0892902cd6d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Getting quotas for user a79957b3f2e94f31bd2cb82290ed0962 and project e38262ed2ed84004a6e01d423cadcae4. Resources: {'instances', 'ram', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 11:41:20.397970 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2e902faa-464b-4fea-a9e7-025724d4f7f5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:20.397970 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2e902faa-464b-4fea-a9e7-025724d4f7f5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1234 microversion: 2.1 time: 0.560402 Jun 17 11:41:20.398475 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2e92279b-6c3c-44fc-80fb-c0892902cd6d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Going to run 1 instances... {{(pid=124845) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 11:41:20.398977 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 14/24] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:19 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1234 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:20.399326 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2e92279b-6c3c-44fc-80fb-c0892902cd6d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='272eb2b7-ddf0-433f-8be8-cdc13c01be77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 11:41:20.717517 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2e92279b-6c3c-44fc-80fb-c0892902cd6d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.917487 Jun 17 11:41:20.723202 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 11/25] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 17 11:41:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 2924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 11:41:20.733276 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c3831f42-7353-479a-9d2a-eba671301739 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:20.736403 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c3831f42-7353-479a-9d2a-eba671301739 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:20.763320 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0888e661-12d6-4ea1-80ef-fa0ecf841d1d tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:20.765684 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0888e661-12d6-4ea1-80ef-fa0ecf841d1d tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] [instance: 8decdd22-7413-438f-94d0-5c3238a2072b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:20.797621 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0888e661-12d6-4ea1-80ef-fa0ecf841d1d tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:20.814211 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0888e661-12d6-4ea1-80ef-fa0ecf841d1d tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:20.821637 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0888e661-12d6-4ea1-80ef-fa0ecf841d1d tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:20.826099 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0888e661-12d6-4ea1-80ef-fa0ecf841d1d tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:21.050244 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c3831f42-7353-479a-9d2a-eba671301739 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:21.067503 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c3831f42-7353-479a-9d2a-eba671301739 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1221 microversion: 2.1 time: 0.338259 Jun 17 11:41:21.073000 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 15/26] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:20 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1221 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:21.409075 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a795bf5b-e3d9-42c7-9bf4-ae69d7682539 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:21.416677 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a795bf5b-e3d9-42c7-9bf4-ae69d7682539 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:21.435022 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a795bf5b-e3d9-42c7-9bf4-ae69d7682539 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:21.435411 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a795bf5b-e3d9-42c7-9bf4-ae69d7682539 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:21.445161 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a795bf5b-e3d9-42c7-9bf4-ae69d7682539 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:21.445650 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a795bf5b-e3d9-42c7-9bf4-ae69d7682539 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:21.751833 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a795bf5b-e3d9-42c7-9bf4-ae69d7682539 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:21.762875 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a795bf5b-e3d9-42c7-9bf4-ae69d7682539 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1298 microversion: 2.1 time: 0.361402 Jun 17 11:41:21.763502 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 16/27] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:21 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1298 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:21.903531 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0888e661-12d6-4ea1-80ef-fa0ecf841d1d tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d78520e9c2483c94050fc91d9e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebd69a2ffc492eae05aaf62e2d8ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:21.915289 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0888e661-12d6-4ea1-80ef-fa0ecf841d1d tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] 10.222.0.45 "GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b" status: 200 len: 1315 microversion: 2.1 time: 1.173065 Jun 17 11:41:21.925571 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 12/28] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:20 2022] GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b => generated 1315 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:22.090768 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e62f4761-0fbd-4cfe-b15f-f9d46709ae14 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:22.093719 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e62f4761-0fbd-4cfe-b15f-f9d46709ae14 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:22.556912 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e62f4761-0fbd-4cfe-b15f-f9d46709ae14 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:22.569360 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e62f4761-0fbd-4cfe-b15f-f9d46709ae14 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1221 microversion: 2.1 time: 0.482618 Jun 17 11:41:22.569969 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 17/29] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:22 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1221 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:22.781818 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b73e5a71-1ccf-4e6e-823a-87a89dcc5f77 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:22.785703 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b73e5a71-1ccf-4e6e-823a-87a89dcc5f77 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:22.797084 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b73e5a71-1ccf-4e6e-823a-87a89dcc5f77 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:22.799895 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b73e5a71-1ccf-4e6e-823a-87a89dcc5f77 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:22.805304 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b73e5a71-1ccf-4e6e-823a-87a89dcc5f77 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:22.805304 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b73e5a71-1ccf-4e6e-823a-87a89dcc5f77 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:22.933870 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-65546111-0152-4204-ac2a-b8d2da567332 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:22.935266 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-65546111-0152-4204-ac2a-b8d2da567332 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] [instance: 8decdd22-7413-438f-94d0-5c3238a2072b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:22.948228 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-65546111-0152-4204-ac2a-b8d2da567332 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:22.949326 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-65546111-0152-4204-ac2a-b8d2da567332 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:22.953551 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-65546111-0152-4204-ac2a-b8d2da567332 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:22.954276 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-65546111-0152-4204-ac2a-b8d2da567332 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:23.866440 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b73e5a71-1ccf-4e6e-823a-87a89dcc5f77 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:23.877531 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b73e5a71-1ccf-4e6e-823a-87a89dcc5f77 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1296 microversion: 2.1 time: 1.099146 Jun 17 11:41:23.878412 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 13/30] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:22 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1296 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:23.898574 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2f1d56b8-80d8-4955-b95c-0168e1d93ebc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:23.899546 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2f1d56b8-80d8-4955-b95c-0168e1d93ebc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:23.930251 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2f1d56b8-80d8-4955-b95c-0168e1d93ebc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:23.932278 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2f1d56b8-80d8-4955-b95c-0168e1d93ebc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:23.933177 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2f1d56b8-80d8-4955-b95c-0168e1d93ebc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:23.933633 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2f1d56b8-80d8-4955-b95c-0168e1d93ebc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:24.209454 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2f1d56b8-80d8-4955-b95c-0168e1d93ebc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:24.218429 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2f1d56b8-80d8-4955-b95c-0168e1d93ebc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1273 microversion: 2.1 time: 0.336617 Jun 17 11:41:24.230025 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 14/31] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:23 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1273 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:24.349794 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-65546111-0152-4204-ac2a-b8d2da567332 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d78520e9c2483c94050fc91d9e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebd69a2ffc492eae05aaf62e2d8ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:24.361686 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-65546111-0152-4204-ac2a-b8d2da567332 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] 10.222.0.45 "GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b" status: 200 len: 1315 microversion: 2.1 time: 1.432583 Jun 17 11:41:24.362369 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 18/32] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:22 2022] GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b => generated 1315 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:24.897270 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4078de69-3b97-409c-9254-d50f531def22 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:24.898634 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4078de69-3b97-409c-9254-d50f531def22 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:24.922842 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4078de69-3b97-409c-9254-d50f531def22 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:24.932227 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4078de69-3b97-409c-9254-d50f531def22 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:24.934784 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4078de69-3b97-409c-9254-d50f531def22 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:24.935916 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4078de69-3b97-409c-9254-d50f531def22 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:25.236627 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c8114f2e-aad9-4fa3-b0c7-3791cad683a7 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:25.237377 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c8114f2e-aad9-4fa3-b0c7-3791cad683a7 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:25.244223 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c8114f2e-aad9-4fa3-b0c7-3791cad683a7 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:25.252687 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c8114f2e-aad9-4fa3-b0c7-3791cad683a7 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:25.253760 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c8114f2e-aad9-4fa3-b0c7-3791cad683a7 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:25.257405 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c8114f2e-aad9-4fa3-b0c7-3791cad683a7 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:26.094437 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c8114f2e-aad9-4fa3-b0c7-3791cad683a7 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:26.103715 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c8114f2e-aad9-4fa3-b0c7-3791cad683a7 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1279 microversion: 2.1 time: 0.870934 Jun 17 11:41:26.110236 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 19/33] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:25 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1279 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:41:26.130050 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-14b7354e-63ec-4b35-b9d2-1e97474f861a tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:26.131736 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-14b7354e-63ec-4b35-b9d2-1e97474f861a tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] [instance: 8decdd22-7413-438f-94d0-5c3238a2072b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:26.144982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-14b7354e-63ec-4b35-b9d2-1e97474f861a tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:26.153841 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-14b7354e-63ec-4b35-b9d2-1e97474f861a tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:26.154868 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-14b7354e-63ec-4b35-b9d2-1e97474f861a tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:26.158009 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-14b7354e-63ec-4b35-b9d2-1e97474f861a tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:26.173373 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-4078de69-3b97-409c-9254-d50f531def22 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:26.177502 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4078de69-3b97-409c-9254-d50f531def22 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1296 microversion: 2.1 time: 1.286128 Jun 17 11:41:26.194147 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 15/34] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:24 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1296 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:26.379108 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-5ce56677-0b16-4f08-8c34-9d66fb3f4552 req-af117f46-2547-40d8-bb20-972edcd3dc51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8decdd22-7413-438f-94d0-5c3238a2072b", "tag": "199985a1-d517-4233-be02-8ddb17816c27"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:41:26.401736 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-5ce56677-0b16-4f08-8c34-9d66fb3f4552 req-af117f46-2547-40d8-bb20-972edcd3dc51 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:26.406194 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-5ce56677-0b16-4f08-8c34-9d66fb3f4552 req-af117f46-2547-40d8-bb20-972edcd3dc51 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:26.499079 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-5ce56677-0b16-4f08-8c34-9d66fb3f4552 req-af117f46-2547-40d8-bb20-972edcd3dc51 service nova] Creating event network-changed:199985a1-d517-4233-be02-8ddb17816c27 for instance 8decdd22-7413-438f-94d0-5c3238a2072b on hv-cinder-83716 Jun 17 11:41:26.504245 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-5ce56677-0b16-4f08-8c34-9d66fb3f4552 req-af117f46-2547-40d8-bb20-972edcd3dc51 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124845) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 17 11:41:26.505737 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-52a68276-2fbe-473a-bb15-b4b8b2485cc9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:26.506442 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-52a68276-2fbe-473a-bb15-b4b8b2485cc9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:26.507508 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-52a68276-2fbe-473a-bb15-b4b8b2485cc9 None None] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:26.508174 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-52a68276-2fbe-473a-bb15-b4b8b2485cc9 None None] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:26.543635 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.compute.rpcapi [None req-52a68276-2fbe-473a-bb15-b4b8b2485cc9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 17 11:41:26.553103 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-52a68276-2fbe-473a-bb15-b4b8b2485cc9 None None] Releasing lock "compute-rpcapi-router" {{(pid=124845) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 17 11:41:26.591935 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-52a68276-2fbe-473a-bb15-b4b8b2485cc9 None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.383691 Jun 17 11:41:26.595896 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 16/35] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:41:26.691304 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=4 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:41:27.139843 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e318e8c0-1543-420b-a22d-c2c732ece67e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:27.140697 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-e318e8c0-1543-420b-a22d-c2c732ece67e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:27.153672 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e318e8c0-1543-420b-a22d-c2c732ece67e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:27.154483 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e318e8c0-1543-420b-a22d-c2c732ece67e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:27.155678 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e318e8c0-1543-420b-a22d-c2c732ece67e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:27.156709 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e318e8c0-1543-420b-a22d-c2c732ece67e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:27.385782 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-e318e8c0-1543-420b-a22d-c2c732ece67e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:27.402452 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-e318e8c0-1543-420b-a22d-c2c732ece67e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1279 microversion: 2.1 time: 0.271436 Jun 17 11:41:27.403255 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 17/36] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:27 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1279 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:41:27.422208 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9c853a78-7429-4530-818a-d86891533720 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:27.429035 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9c853a78-7429-4530-818a-d86891533720 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:27.453968 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9c853a78-7429-4530-818a-d86891533720 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:27.453968 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9c853a78-7429-4530-818a-d86891533720 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:27.453968 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9c853a78-7429-4530-818a-d86891533720 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:27.453968 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9c853a78-7429-4530-818a-d86891533720 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:27.664615 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-14b7354e-63ec-4b35-b9d2-1e97474f861a tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d78520e9c2483c94050fc91d9e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebd69a2ffc492eae05aaf62e2d8ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:27.679554 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-14b7354e-63ec-4b35-b9d2-1e97474f861a tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] 10.222.0.45 "GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b" status: 200 len: 1315 microversion: 2.1 time: 1.564907 Jun 17 11:41:27.689790 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 20/37] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:26 2022] GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b => generated 1315 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:27.928440 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-741965a1-52b2-43e5-b55c-6751ddb85551 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1341714531", "imageRef": "272eb2b7-ddf0-433f-8be8-cdc13c01be77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "562be4fa-7f02-4e16-ab0e-484de596db99"}], "security_groups": [{"name": "tempest-securitygroup--157722722"}], "key_name": "tempest-keypair-801864130", "user_data": "}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:41:28.553271 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.network.neutron [None req-741965a1-52b2-43e5-b55c-6751ddb85551 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] validate_networks() for [('562be4fa-7f02-4e16-ab0e-484de596db99', None, None, None, None, None)] {{(pid=124844) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 11:41:29.190271 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9c853a78-7429-4530-818a-d86891533720 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:29.208421 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9c853a78-7429-4530-818a-d86891533720 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1364 microversion: 2.1 time: 1.802334 Jun 17 11:41:29.216290 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 18/38] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:27 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1364 bytes in 1812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:29.239023 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2073a7a9-8bb0-49f4-b0aa-656ac37bf611 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:29.241299 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2073a7a9-8bb0-49f4-b0aa-656ac37bf611 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:29.253863 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=9 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:41:29.278863 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2073a7a9-8bb0-49f4-b0aa-656ac37bf611 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:29.279581 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2073a7a9-8bb0-49f4-b0aa-656ac37bf611 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:29.280482 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2073a7a9-8bb0-49f4-b0aa-656ac37bf611 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:29.280925 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2073a7a9-8bb0-49f4-b0aa-656ac37bf611 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:29.946601 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2073a7a9-8bb0-49f4-b0aa-656ac37bf611 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:29.966377 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2073a7a9-8bb0-49f4-b0aa-656ac37bf611 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1279 microversion: 2.1 time: 0.747470 Jun 17 11:41:29.967026 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 19/39] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:29 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1279 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:29.983525 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-61cef948-6cea-43b2-b7c2-72fb95f28a07 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:29.984198 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-61cef948-6cea-43b2-b7c2-72fb95f28a07 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] [instance: 8decdd22-7413-438f-94d0-5c3238a2072b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:29.992847 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-61cef948-6cea-43b2-b7c2-72fb95f28a07 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:29.993761 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-61cef948-6cea-43b2-b7c2-72fb95f28a07 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:29.994795 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-61cef948-6cea-43b2-b7c2-72fb95f28a07 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:29.995427 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-61cef948-6cea-43b2-b7c2-72fb95f28a07 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:30.270767 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=28 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:41:31.425303 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-61cef948-6cea-43b2-b7c2-72fb95f28a07 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d78520e9c2483c94050fc91d9e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebd69a2ffc492eae05aaf62e2d8ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:31.446592 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-61cef948-6cea-43b2-b7c2-72fb95f28a07 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] 10.222.0.45 "GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b" status: 200 len: 1315 microversion: 2.1 time: 1.478360 Jun 17 11:41:31.448590 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 20/40] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:29 2022] GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b => generated 1315 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:31.464850 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-741965a1-52b2-43e5-b55c-6751ddb85551 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Flavor limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 11:41:31.473717 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-741965a1-52b2-43e5-b55c-6751ddb85551 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Image limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 11:41:31.473717 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-741965a1-52b2-43e5-b55c-6751ddb85551 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Flavor pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 11:41:31.473717 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-741965a1-52b2-43e5-b55c-6751ddb85551 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Image pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 11:41:31.473717 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-741965a1-52b2-43e5-b55c-6751ddb85551 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 11:41:31.487398 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-155a9e12-936e-457f-865d-46d6ce16863d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-240451424", "imageRef": "272eb2b7-ddf0-433f-8be8-cdc13c01be77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e586d9ae-1ebe-4cac-a969-e5265b9acb47"}], "security_groups": [{"name": "tempest-securitygroup--1406112148"}], "key_name": "tempest-keypair-1601128479", "user_data": "}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:41:31.490387 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-741965a1-52b2-43e5-b55c-6751ddb85551 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:31.491183 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-741965a1-52b2-43e5-b55c-6751ddb85551 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:31.494069 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-741965a1-52b2-43e5-b55c-6751ddb85551 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:31.495035 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-741965a1-52b2-43e5-b55c-6751ddb85551 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:31.555089 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-741965a1-52b2-43e5-b55c-6751ddb85551 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Getting quotas for project c58cf63264414f30a98161f6027daad0. Resources: {'instances', 'ram', 'cores'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 11:41:31.560934 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-741965a1-52b2-43e5-b55c-6751ddb85551 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Getting quotas for user 2e58eacbbb9e41fdbbb13f5b39be782a and project c58cf63264414f30a98161f6027daad0. Resources: {'instances', 'ram', 'cores'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 11:41:31.579274 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-741965a1-52b2-43e5-b55c-6751ddb85551 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Going to run 1 instances... {{(pid=124844) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 11:41:31.582339 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-741965a1-52b2-43e5-b55c-6751ddb85551 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: be48aa4e-115e-4d58-8940-f722120f4664] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='272eb2b7-ddf0-433f-8be8-cdc13c01be77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 11:41:31.845539 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-741965a1-52b2-43e5-b55c-6751ddb85551 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.919004 Jun 17 11:41:31.845539 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 21/41] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 17 11:41:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 3921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 17 11:41:31.886656 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f1ab8db4-2e96-4f86-8916-ea075b49b1c9 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:31.886656 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f1ab8db4-2e96-4f86-8916-ea075b49b1c9 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:31.892649 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f1ab8db4-2e96-4f86-8916-ea075b49b1c9 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:31.894579 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f1ab8db4-2e96-4f86-8916-ea075b49b1c9 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:31.896159 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f1ab8db4-2e96-4f86-8916-ea075b49b1c9 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:31.897585 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f1ab8db4-2e96-4f86-8916-ea075b49b1c9 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:31.985408 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.network.neutron [None req-155a9e12-936e-457f-865d-46d6ce16863d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] validate_networks() for [('e586d9ae-1ebe-4cac-a969-e5265b9acb47', None, None, None, None, None)] {{(pid=124845) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 11:41:32.494165 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f1ab8db4-2e96-4f86-8916-ea075b49b1c9 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:32.504687 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f1ab8db4-2e96-4f86-8916-ea075b49b1c9 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1364 microversion: 2.1 time: 0.658170 Jun 17 11:41:32.505505 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 22/42] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:31 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1364 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:32.530258 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ad8d2be8-8e89-4817-9714-c35886d0cab1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:32.531692 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ad8d2be8-8e89-4817-9714-c35886d0cab1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:32.548498 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ad8d2be8-8e89-4817-9714-c35886d0cab1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:32.550673 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ad8d2be8-8e89-4817-9714-c35886d0cab1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:32.552079 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ad8d2be8-8e89-4817-9714-c35886d0cab1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:32.553079 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ad8d2be8-8e89-4817-9714-c35886d0cab1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:33.221918 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ad8d2be8-8e89-4817-9714-c35886d0cab1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:33.237328 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ad8d2be8-8e89-4817-9714-c35886d0cab1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1321 microversion: 2.1 time: 0.720732 Jun 17 11:41:33.259963 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 23/43] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:32 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1321 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:33.670973 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-d7f214c6-22b7-4a9b-afba-0eb6f006306e req-0e943bca-b55c-44c6-a433-a0d5b3f9ffa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8cd69a4-437d-4db2-bd02-b485b06773e2", "tag": "c8a5211f-0d5a-4f8f-a4a6-9d9fe6173ce8"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:41:33.697748 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-d7f214c6-22b7-4a9b-afba-0eb6f006306e req-0e943bca-b55c-44c6-a433-a0d5b3f9ffa3 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:33.698305 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-d7f214c6-22b7-4a9b-afba-0eb6f006306e req-0e943bca-b55c-44c6-a433-a0d5b3f9ffa3 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:33.735157 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-d7f214c6-22b7-4a9b-afba-0eb6f006306e req-0e943bca-b55c-44c6-a433-a0d5b3f9ffa3 service nova] Creating event network-changed:c8a5211f-0d5a-4f8f-a4a6-9d9fe6173ce8 for instance b8cd69a4-437d-4db2-bd02-b485b06773e2 on hv-cinder-83716 Jun 17 11:41:33.735816 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-d7f214c6-22b7-4a9b-afba-0eb6f006306e req-0e943bca-b55c-44c6-a433-a0d5b3f9ffa3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124844) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 17 11:41:33.736957 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-78ee167f-5d6e-40a4-9f1f-1c4eaa46a0c4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:33.737412 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-78ee167f-5d6e-40a4-9f1f-1c4eaa46a0c4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:33.740011 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-78ee167f-5d6e-40a4-9f1f-1c4eaa46a0c4 None None] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:33.740498 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-78ee167f-5d6e-40a4-9f1f-1c4eaa46a0c4 None None] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:33.774935 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.compute.rpcapi [None req-78ee167f-5d6e-40a4-9f1f-1c4eaa46a0c4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 17 11:41:33.774935 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-78ee167f-5d6e-40a4-9f1f-1c4eaa46a0c4 None None] Releasing lock "compute-rpcapi-router" {{(pid=124844) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 17 11:41:33.807418 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-78ee167f-5d6e-40a4-9f1f-1c4eaa46a0c4 None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.545451 Jun 17 11:41:33.808011 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 24/44] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:41:33.815103 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2dfc5046-8eba-4c15-b9ea-ae7938e78e1c tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:33.816079 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-2dfc5046-8eba-4c15-b9ea-ae7938e78e1c tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: be48aa4e-115e-4d58-8940-f722120f4664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:33.836605 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2dfc5046-8eba-4c15-b9ea-ae7938e78e1c tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:33.836977 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2dfc5046-8eba-4c15-b9ea-ae7938e78e1c tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:33.837900 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2dfc5046-8eba-4c15-b9ea-ae7938e78e1c tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:33.838437 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2dfc5046-8eba-4c15-b9ea-ae7938e78e1c tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:34.070598 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2dfc5046-8eba-4c15-b9ea-ae7938e78e1c tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:34.093169 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2dfc5046-8eba-4c15-b9ea-ae7938e78e1c tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664" status: 200 len: 1245 microversion: 2.1 time: 0.283668 Jun 17 11:41:34.096613 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 25/45] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:33 2022] GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664 => generated 1245 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:34.165723 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-92726cec-c6e3-4644-93d3-82f8991c8c84 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:34.165723 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-92726cec-c6e3-4644-93d3-82f8991c8c84 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] [instance: 8decdd22-7413-438f-94d0-5c3238a2072b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:34.165723 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:41:34.165723 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-92726cec-c6e3-4644-93d3-82f8991c8c84 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:34.165723 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-92726cec-c6e3-4644-93d3-82f8991c8c84 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:34.166389 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-92726cec-c6e3-4644-93d3-82f8991c8c84 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:34.166389 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-92726cec-c6e3-4644-93d3-82f8991c8c84 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:34.213285 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-155a9e12-936e-457f-865d-46d6ce16863d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Flavor limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 11:41:34.213820 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-155a9e12-936e-457f-865d-46d6ce16863d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Image limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 11:41:34.214174 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-155a9e12-936e-457f-865d-46d6ce16863d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Flavor pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 11:41:34.214584 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-155a9e12-936e-457f-865d-46d6ce16863d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Image pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 11:41:34.228171 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-155a9e12-936e-457f-865d-46d6ce16863d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 11:41:34.228171 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-155a9e12-936e-457f-865d-46d6ce16863d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:34.228535 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-155a9e12-936e-457f-865d-46d6ce16863d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:34.233665 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-155a9e12-936e-457f-865d-46d6ce16863d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:34.234777 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-155a9e12-936e-457f-865d-46d6ce16863d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:34.268773 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-155a9e12-936e-457f-865d-46d6ce16863d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Getting quotas for project bc8dc1335e284eee8cca45d5720d5f16. Resources: {'instances', 'ram', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 11:41:34.274717 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-155a9e12-936e-457f-865d-46d6ce16863d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Getting quotas for user d817bad669fc4d6f829bf6eb57773b23 and project bc8dc1335e284eee8cca45d5720d5f16. Resources: {'instances', 'ram', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 11:41:34.291775 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-155a9e12-936e-457f-865d-46d6ce16863d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Going to run 1 instances... {{(pid=124845) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 11:41:34.302543 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-155a9e12-936e-457f-865d-46d6ce16863d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='272eb2b7-ddf0-433f-8be8-cdc13c01be77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 11:41:34.532964 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-155a9e12-936e-457f-865d-46d6ce16863d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.062872 Jun 17 11:41:34.532964 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 21/46] 10.222.0.45 () {62 vars in 1187 bytes} [Fri Jun 17 11:41:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 3066 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 17 11:41:34.532964 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f9a49f20-37ec-45d6-8599-809d7139d005 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:34.532964 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f9a49f20-37ec-45d6-8599-809d7139d005 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:34.532964 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f9a49f20-37ec-45d6-8599-809d7139d005 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:34.533735 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f9a49f20-37ec-45d6-8599-809d7139d005 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:34.533735 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f9a49f20-37ec-45d6-8599-809d7139d005 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:34.533735 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f9a49f20-37ec-45d6-8599-809d7139d005 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:34.590310 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-92726cec-c6e3-4644-93d3-82f8991c8c84 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d78520e9c2483c94050fc91d9e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebd69a2ffc492eae05aaf62e2d8ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:34.598568 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-92726cec-c6e3-4644-93d3-82f8991c8c84 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] 10.222.0.45 "GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b" status: 200 len: 1315 microversion: 2.1 time: 0.488752 Jun 17 11:41:34.599639 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 26/47] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:34 2022] GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:34.613925 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-bf411638-029f-4807-a9d0-6300ba6b08d2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:34.615093 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-bf411638-029f-4807-a9d0-6300ba6b08d2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:34.632815 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bf411638-029f-4807-a9d0-6300ba6b08d2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:34.632815 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bf411638-029f-4807-a9d0-6300ba6b08d2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:34.632815 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bf411638-029f-4807-a9d0-6300ba6b08d2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:34.632815 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bf411638-029f-4807-a9d0-6300ba6b08d2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:34.887671 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f9a49f20-37ec-45d6-8599-809d7139d005 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:34.918341 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f9a49f20-37ec-45d6-8599-809d7139d005 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1364 microversion: 2.1 time: 0.402094 Jun 17 11:41:34.918985 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 22/48] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:34 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1364 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:34.925099 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f2c1cbef-4445-4c6e-8f5e-8557f1aae089 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:34.925617 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f2c1cbef-4445-4c6e-8f5e-8557f1aae089 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:34.958216 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-bf411638-029f-4807-a9d0-6300ba6b08d2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:34.970675 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-bf411638-029f-4807-a9d0-6300ba6b08d2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1321 microversion: 2.1 time: 0.369206 Jun 17 11:41:34.971874 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 27/49] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:34 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1321 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:35.008928 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-85835943-876b-470a-bdb6-99d14f848685 req-ce5c541f-11a0-46fb-90a4-cd8c46345fbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39a1319f-9f84-46db-9981-30ff7e4acc74", "tag": "845a8d6f-82d9-4eca-a43c-35be0c12da3d"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:41:35.018903 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-85835943-876b-470a-bdb6-99d14f848685 req-ce5c541f-11a0-46fb-90a4-cd8c46345fbd service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:35.019551 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-85835943-876b-470a-bdb6-99d14f848685 req-ce5c541f-11a0-46fb-90a4-cd8c46345fbd service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:35.032967 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f2c1cbef-4445-4c6e-8f5e-8557f1aae089 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:35.038567 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-85835943-876b-470a-bdb6-99d14f848685 req-ce5c541f-11a0-46fb-90a4-cd8c46345fbd service nova] Creating event network-changed:845a8d6f-82d9-4eca-a43c-35be0c12da3d for instance 39a1319f-9f84-46db-9981-30ff7e4acc74 on hv-cinder-83716 Jun 17 11:41:35.044079 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-85835943-876b-470a-bdb6-99d14f848685 req-ce5c541f-11a0-46fb-90a4-cd8c46345fbd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047613 Jun 17 11:41:35.045526 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 28/50] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:41:35.054597 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f2c1cbef-4445-4c6e-8f5e-8557f1aae089 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:35.054597 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f2c1cbef-4445-4c6e-8f5e-8557f1aae089 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:35.059333 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f2c1cbef-4445-4c6e-8f5e-8557f1aae089 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1281 microversion: 2.20 time: 0.135675 Jun 17 11:41:35.059333 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 23/51] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:41:34 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1281 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:41:35.114878 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-62c21a99-27b7-4f10-986b-74e33a5aafe7 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:35.116677 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-62c21a99-27b7-4f10-986b-74e33a5aafe7 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: be48aa4e-115e-4d58-8940-f722120f4664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:35.128010 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-62c21a99-27b7-4f10-986b-74e33a5aafe7 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:35.134970 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-62c21a99-27b7-4f10-986b-74e33a5aafe7 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:35.137168 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-62c21a99-27b7-4f10-986b-74e33a5aafe7 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:35.138981 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-62c21a99-27b7-4f10-986b-74e33a5aafe7 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:35.361105 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-62c21a99-27b7-4f10-986b-74e33a5aafe7 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:35.372967 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-62c21a99-27b7-4f10-986b-74e33a5aafe7 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664" status: 200 len: 1293 microversion: 2.1 time: 0.262341 Jun 17 11:41:35.383552 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 29/52] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:35 2022] GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664 => generated 1293 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:35.618868 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2538cae3-def6-4090-bd1a-5ec638497815 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:35.621795 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2538cae3-def6-4090-bd1a-5ec638497815 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] [instance: 8decdd22-7413-438f-94d0-5c3238a2072b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:35.638159 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2538cae3-def6-4090-bd1a-5ec638497815 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:35.638835 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2538cae3-def6-4090-bd1a-5ec638497815 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:35.641341 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2538cae3-def6-4090-bd1a-5ec638497815 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:35.641973 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2538cae3-def6-4090-bd1a-5ec638497815 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:35.851221 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2538cae3-def6-4090-bd1a-5ec638497815 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d78520e9c2483c94050fc91d9e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebd69a2ffc492eae05aaf62e2d8ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:35.861483 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2538cae3-def6-4090-bd1a-5ec638497815 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] 10.222.0.45 "GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b" status: 200 len: 1315 microversion: 2.1 time: 0.246336 Jun 17 11:41:35.863293 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 24/53] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:35 2022] GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:35.940004 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-13f9cc85-e9ab-4cf5-95d0-003b5d8ff969 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:35.940771 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-13f9cc85-e9ab-4cf5-95d0-003b5d8ff969 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:35.949848 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-13f9cc85-e9ab-4cf5-95d0-003b5d8ff969 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:35.950529 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-13f9cc85-e9ab-4cf5-95d0-003b5d8ff969 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:35.951451 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-13f9cc85-e9ab-4cf5-95d0-003b5d8ff969 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:35.952021 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-13f9cc85-e9ab-4cf5-95d0-003b5d8ff969 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:35.956521 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=97 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:41:35.989322 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-478686e9-f75b-4fb5-b50e-533cc1b76257 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:35.989854 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-478686e9-f75b-4fb5-b50e-533cc1b76257 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:35.996580 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-478686e9-f75b-4fb5-b50e-533cc1b76257 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:35.997032 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-478686e9-f75b-4fb5-b50e-533cc1b76257 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:35.997815 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-478686e9-f75b-4fb5-b50e-533cc1b76257 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:35.998254 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-478686e9-f75b-4fb5-b50e-533cc1b76257 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:36.155392 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-13f9cc85-e9ab-4cf5-95d0-003b5d8ff969 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:36.164463 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-13f9cc85-e9ab-4cf5-95d0-003b5d8ff969 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1364 microversion: 2.1 time: 0.231584 Jun 17 11:41:36.165353 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 30/54] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:35 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1364 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:36.170931 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d2ea00e0-951d-4ddc-a10f-c4071aec8d35 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:36.171903 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d2ea00e0-951d-4ddc-a10f-c4071aec8d35 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:36.178984 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-478686e9-f75b-4fb5-b50e-533cc1b76257 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:36.179120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d2ea00e0-951d-4ddc-a10f-c4071aec8d35 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:36.179638 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d2ea00e0-951d-4ddc-a10f-c4071aec8d35 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:36.180511 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d2ea00e0-951d-4ddc-a10f-c4071aec8d35 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:36.180840 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d2ea00e0-951d-4ddc-a10f-c4071aec8d35 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:36.187324 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-478686e9-f75b-4fb5-b50e-533cc1b76257 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1321 microversion: 2.1 time: 0.201998 Jun 17 11:41:36.197640 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 25/55] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:35 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:41:36.251974 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d2ea00e0-951d-4ddc-a10f-c4071aec8d35 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:36.261749 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d2ea00e0-951d-4ddc-a10f-c4071aec8d35 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:36.263324 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d2ea00e0-951d-4ddc-a10f-c4071aec8d35 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:36.264510 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d2ea00e0-951d-4ddc-a10f-c4071aec8d35 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1285 microversion: 2.20 time: 0.097310 Jun 17 11:41:36.265088 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 31/56] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:41:36 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:41:36.400434 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-98616f37-6093-4b09-ab96-3c1175b5ac76 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:36.401194 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-98616f37-6093-4b09-ab96-3c1175b5ac76 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: be48aa4e-115e-4d58-8940-f722120f4664] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:36.408300 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-98616f37-6093-4b09-ab96-3c1175b5ac76 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:36.408751 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-98616f37-6093-4b09-ab96-3c1175b5ac76 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:36.409535 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-98616f37-6093-4b09-ab96-3c1175b5ac76 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:36.409974 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-98616f37-6093-4b09-ab96-3c1175b5ac76 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:36.479708 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-98616f37-6093-4b09-ab96-3c1175b5ac76 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:36.491959 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-98616f37-6093-4b09-ab96-3c1175b5ac76 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664" status: 200 len: 1293 microversion: 2.1 time: 0.094886 Jun 17 11:41:36.493233 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 26/57] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:36 2022] GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664 => generated 1293 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:36.880081 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-7ed1d1ee-bad3-4b70-b309-2dd90fa0151b tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:36.880846 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7ed1d1ee-bad3-4b70-b309-2dd90fa0151b tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] [instance: 8decdd22-7413-438f-94d0-5c3238a2072b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:36.891600 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7ed1d1ee-bad3-4b70-b309-2dd90fa0151b tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:36.892360 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7ed1d1ee-bad3-4b70-b309-2dd90fa0151b tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:36.893409 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7ed1d1ee-bad3-4b70-b309-2dd90fa0151b tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:36.894149 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7ed1d1ee-bad3-4b70-b309-2dd90fa0151b tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:37.042884 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7ed1d1ee-bad3-4b70-b309-2dd90fa0151b tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d78520e9c2483c94050fc91d9e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebd69a2ffc492eae05aaf62e2d8ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:37.052978 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-7ed1d1ee-bad3-4b70-b309-2dd90fa0151b tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] 10.222.0.45 "GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b" status: 200 len: 1315 microversion: 2.1 time: 0.177298 Jun 17 11:41:37.054297 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 32/58] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:36 2022] GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:37.093411 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-42e0ee76-247f-48a7-929e-b8c00c212b6a req-5460b98e-3612-4baf-9d38-6ae78bfdc3bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76c24c0d-60e5-45e5-afeb-d8595d5116f5", "tag": "fbcdaa75-cd33-46e4-a7fd-57c88e44b5b6"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:41:37.106566 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-42e0ee76-247f-48a7-929e-b8c00c212b6a req-5460b98e-3612-4baf-9d38-6ae78bfdc3bc service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:37.107084 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-42e0ee76-247f-48a7-929e-b8c00c212b6a req-5460b98e-3612-4baf-9d38-6ae78bfdc3bc service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:37.121269 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-42e0ee76-247f-48a7-929e-b8c00c212b6a req-5460b98e-3612-4baf-9d38-6ae78bfdc3bc service nova] Creating event network-changed:fbcdaa75-cd33-46e4-a7fd-57c88e44b5b6 for instance 76c24c0d-60e5-45e5-afeb-d8595d5116f5 on hv-cinder-83716 Jun 17 11:41:37.126537 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-42e0ee76-247f-48a7-929e-b8c00c212b6a req-5460b98e-3612-4baf-9d38-6ae78bfdc3bc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038005 Jun 17 11:41:37.127480 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 27/59] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:41:37.182255 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-53157631-1a59-4eae-b779-6afe52201b68 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:37.182882 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-53157631-1a59-4eae-b779-6afe52201b68 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:37.189636 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-53157631-1a59-4eae-b779-6afe52201b68 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:37.190093 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-53157631-1a59-4eae-b779-6afe52201b68 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:37.190891 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-53157631-1a59-4eae-b779-6afe52201b68 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:37.191474 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-53157631-1a59-4eae-b779-6afe52201b68 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:37.207100 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-62b0afae-1d96-485c-b6ac-9dc8abc89854 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:37.207225 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-62b0afae-1d96-485c-b6ac-9dc8abc89854 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:37.214844 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-62b0afae-1d96-485c-b6ac-9dc8abc89854 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:37.215298 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-62b0afae-1d96-485c-b6ac-9dc8abc89854 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:37.216116 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-62b0afae-1d96-485c-b6ac-9dc8abc89854 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:37.217130 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-62b0afae-1d96-485c-b6ac-9dc8abc89854 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:37.429369 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-53157631-1a59-4eae-b779-6afe52201b68 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:37.429872 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-62b0afae-1d96-485c-b6ac-9dc8abc89854 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:37.432862 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-53157631-1a59-4eae-b779-6afe52201b68 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1364 microversion: 2.1 time: 0.254486 Jun 17 11:41:37.434255 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-62b0afae-1d96-485c-b6ac-9dc8abc89854 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1321 microversion: 2.1 time: 0.231517 Jun 17 11:41:37.435453 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 33/60] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:37 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1364 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:37.440755 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-209f8a2f-0fc8-46da-9738-477db536ce9e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:37.441535 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-209f8a2f-0fc8-46da-9738-477db536ce9e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:37.445738 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 28/61] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:37 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:41:37.449797 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-209f8a2f-0fc8-46da-9738-477db536ce9e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:37.450251 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-209f8a2f-0fc8-46da-9738-477db536ce9e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:37.451021 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-209f8a2f-0fc8-46da-9738-477db536ce9e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:37.451654 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-209f8a2f-0fc8-46da-9738-477db536ce9e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:37.510181 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a2728d8d-2975-4bf6-a4fa-5961a35e549d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:37.511232 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a2728d8d-2975-4bf6-a4fa-5961a35e549d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: be48aa4e-115e-4d58-8940-f722120f4664] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:37.518843 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a2728d8d-2975-4bf6-a4fa-5961a35e549d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:37.520231 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a2728d8d-2975-4bf6-a4fa-5961a35e549d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:37.521780 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a2728d8d-2975-4bf6-a4fa-5961a35e549d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:37.523230 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a2728d8d-2975-4bf6-a4fa-5961a35e549d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:37.527783 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-209f8a2f-0fc8-46da-9738-477db536ce9e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:37.537582 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-209f8a2f-0fc8-46da-9738-477db536ce9e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:37.539094 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-209f8a2f-0fc8-46da-9738-477db536ce9e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:37.540275 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-209f8a2f-0fc8-46da-9738-477db536ce9e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1285 microversion: 2.20 time: 0.103365 Jun 17 11:41:37.540953 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 34/62] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:41:37 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:41:37.567299 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=100 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:41:37.624762 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a2728d8d-2975-4bf6-a4fa-5961a35e549d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:37.634282 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a2728d8d-2975-4bf6-a4fa-5961a35e549d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664" status: 200 len: 1293 microversion: 2.1 time: 0.129345 Jun 17 11:41:37.639576 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 29/63] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:37 2022] GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664 => generated 1293 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:41:38.072222 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8f36d9cb-4731-40f8-83d4-b299dea6b69e tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:38.073371 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-8f36d9cb-4731-40f8-83d4-b299dea6b69e tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] [instance: 8decdd22-7413-438f-94d0-5c3238a2072b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:38.080750 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8f36d9cb-4731-40f8-83d4-b299dea6b69e tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:38.081766 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8f36d9cb-4731-40f8-83d4-b299dea6b69e tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:38.083052 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8f36d9cb-4731-40f8-83d4-b299dea6b69e tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:38.083709 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8f36d9cb-4731-40f8-83d4-b299dea6b69e tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:38.451979 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-96d6d276-5759-46c8-8094-692f23185e65 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:38.452708 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-96d6d276-5759-46c8-8094-692f23185e65 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:38.465949 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-96d6d276-5759-46c8-8094-692f23185e65 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:38.466414 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-96d6d276-5759-46c8-8094-692f23185e65 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:38.467235 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-96d6d276-5759-46c8-8094-692f23185e65 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:38.467712 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-96d6d276-5759-46c8-8094-692f23185e65 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:38.980479 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-96d6d276-5759-46c8-8094-692f23185e65 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:38.988559 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-96d6d276-5759-46c8-8094-692f23185e65 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1364 microversion: 2.1 time: 0.541022 Jun 17 11:41:38.994630 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 30/64] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:38 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1364 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:41:39.007203 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-1f78342c-c8f3-48d7-b49c-770f414f471e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:39.008203 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-1f78342c-c8f3-48d7-b49c-770f414f471e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:39.019076 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1f78342c-c8f3-48d7-b49c-770f414f471e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:39.019549 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1f78342c-c8f3-48d7-b49c-770f414f471e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:39.020519 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1f78342c-c8f3-48d7-b49c-770f414f471e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:39.020953 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1f78342c-c8f3-48d7-b49c-770f414f471e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:39.085366 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-8f36d9cb-4731-40f8-83d4-b299dea6b69e tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d78520e9c2483c94050fc91d9e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebd69a2ffc492eae05aaf62e2d8ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:39.093225 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-8f36d9cb-4731-40f8-83d4-b299dea6b69e tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] 10.222.0.45 "GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b" status: 200 len: 1315 microversion: 2.1 time: 1.026589 Jun 17 11:41:39.095884 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 35/65] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:38 2022] GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b => generated 1315 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:39.103061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6c259994-4814-4614-bbd5-1baf1c29e0b0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:39.103946 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-6c259994-4814-4614-bbd5-1baf1c29e0b0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:39.120170 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6c259994-4814-4614-bbd5-1baf1c29e0b0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:39.120631 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6c259994-4814-4614-bbd5-1baf1c29e0b0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:39.121438 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6c259994-4814-4614-bbd5-1baf1c29e0b0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:39.123319 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6c259994-4814-4614-bbd5-1baf1c29e0b0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:39.242003 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-6c259994-4814-4614-bbd5-1baf1c29e0b0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:39.275325 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-6c259994-4814-4614-bbd5-1baf1c29e0b0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:39.284587 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-6c259994-4814-4614-bbd5-1baf1c29e0b0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:39.289088 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-6c259994-4814-4614-bbd5-1baf1c29e0b0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1333 microversion: 2.20 time: 0.191767 Jun 17 11:41:39.292638 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 36/66] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:41:39 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1333 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:41:39.310337 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-0acd5b22-2701-45fc-b870-652abb66ace6 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:39.311146 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-0acd5b22-2701-45fc-b870-652abb66ace6 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: be48aa4e-115e-4d58-8940-f722120f4664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:39.327216 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0acd5b22-2701-45fc-b870-652abb66ace6 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:39.327727 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0acd5b22-2701-45fc-b870-652abb66ace6 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:39.328522 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0acd5b22-2701-45fc-b870-652abb66ace6 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:39.328968 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0acd5b22-2701-45fc-b870-652abb66ace6 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:39.381343 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-1f78342c-c8f3-48d7-b49c-770f414f471e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:39.392304 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-1f78342c-c8f3-48d7-b49c-770f414f471e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1321 microversion: 2.1 time: 0.395178 Jun 17 11:41:39.393603 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 31/67] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:38 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1321 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:39.478708 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-0acd5b22-2701-45fc-b870-652abb66ace6 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:39.487177 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-0acd5b22-2701-45fc-b870-652abb66ace6 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664" status: 200 len: 1299 microversion: 2.1 time: 0.180897 Jun 17 11:41:39.488077 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 37/68] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:39 2022] GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664 => generated 1299 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:40.010969 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b4a7f173-577e-482c-b29e-ff9b38e727bf tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:40.011782 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b4a7f173-577e-482c-b29e-ff9b38e727bf tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:40.028436 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b4a7f173-577e-482c-b29e-ff9b38e727bf tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:40.029298 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b4a7f173-577e-482c-b29e-ff9b38e727bf tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:40.030424 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b4a7f173-577e-482c-b29e-ff9b38e727bf tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:40.031079 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b4a7f173-577e-482c-b29e-ff9b38e727bf tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:40.117491 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-85c096dd-ba4e-410d-922a-ffbde8e4bc09 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:40.118048 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-85c096dd-ba4e-410d-922a-ffbde8e4bc09 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] [instance: 8decdd22-7413-438f-94d0-5c3238a2072b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:40.126839 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-85c096dd-ba4e-410d-922a-ffbde8e4bc09 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:40.127354 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-85c096dd-ba4e-410d-922a-ffbde8e4bc09 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:40.128278 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-85c096dd-ba4e-410d-922a-ffbde8e4bc09 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:40.128782 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-85c096dd-ba4e-410d-922a-ffbde8e4bc09 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:40.778135 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b4a7f173-577e-482c-b29e-ff9b38e727bf tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:40.785764 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b4a7f173-577e-482c-b29e-ff9b38e727bf tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1364 microversion: 2.1 time: 0.779509 Jun 17 11:41:40.786351 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 32/69] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:40 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1364 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:40.792297 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-24020217-492f-4f01-9d85-d92a8f8bccec tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:40.792983 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-24020217-492f-4f01-9d85-d92a8f8bccec tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:40.799564 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-24020217-492f-4f01-9d85-d92a8f8bccec tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:40.800059 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-24020217-492f-4f01-9d85-d92a8f8bccec tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:40.800844 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-24020217-492f-4f01-9d85-d92a8f8bccec tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:40.801309 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-24020217-492f-4f01-9d85-d92a8f8bccec tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:40.818830 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-85c096dd-ba4e-410d-922a-ffbde8e4bc09 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d78520e9c2483c94050fc91d9e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebd69a2ffc492eae05aaf62e2d8ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:40.832850 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-85c096dd-ba4e-410d-922a-ffbde8e4bc09 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] 10.222.0.45 "GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b" status: 200 len: 1315 microversion: 2.1 time: 0.721213 Jun 17 11:41:40.834025 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 38/70] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:40 2022] GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b => generated 1315 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:40.840212 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1aca45b0-e374-4a69-a7ca-3f0115189fca tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:40.841105 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-1aca45b0-e374-4a69-a7ca-3f0115189fca tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:40.847883 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1aca45b0-e374-4a69-a7ca-3f0115189fca tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:40.849102 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1aca45b0-e374-4a69-a7ca-3f0115189fca tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:40.850141 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1aca45b0-e374-4a69-a7ca-3f0115189fca tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:40.851252 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1aca45b0-e374-4a69-a7ca-3f0115189fca tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:40.955568 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-24020217-492f-4f01-9d85-d92a8f8bccec tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:40.973062 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-24020217-492f-4f01-9d85-d92a8f8bccec tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:40.974528 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-24020217-492f-4f01-9d85-d92a8f8bccec tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:40.976257 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-24020217-492f-4f01-9d85-d92a8f8bccec tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1341 microversion: 2.20 time: 0.188980 Jun 17 11:41:40.988370 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 33/71] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:41:40 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1341 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:41:40.996442 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-7e6c3301-7280-425d-9ee8-d29daf706919 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:40.996442 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-7e6c3301-7280-425d-9ee8-d29daf706919 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: be48aa4e-115e-4d58-8940-f722120f4664] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:41.001578 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7e6c3301-7280-425d-9ee8-d29daf706919 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:41.002393 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7e6c3301-7280-425d-9ee8-d29daf706919 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:41.003347 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7e6c3301-7280-425d-9ee8-d29daf706919 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:41.003956 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7e6c3301-7280-425d-9ee8-d29daf706919 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:41.138169 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-1aca45b0-e374-4a69-a7ca-3f0115189fca tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:41.157592 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-1aca45b0-e374-4a69-a7ca-3f0115189fca tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1321 microversion: 2.1 time: 0.321515 Jun 17 11:41:41.158758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 39/72] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:40 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1321 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:41.403098 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-7e6c3301-7280-425d-9ee8-d29daf706919 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:41.413644 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-7e6c3301-7280-425d-9ee8-d29daf706919 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664" status: 200 len: 1366 microversion: 2.1 time: 0.423648 Jun 17 11:41:41.415738 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 34/73] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:40 2022] GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664 => generated 1366 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:41.803194 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2a647c1b-6cb3-4197-8351-810e31681aee tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:41.804547 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-2a647c1b-6cb3-4197-8351-810e31681aee tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:41.806317 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=30 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:41:41.811250 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2a647c1b-6cb3-4197-8351-810e31681aee tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:41.811730 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2a647c1b-6cb3-4197-8351-810e31681aee tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:41.812494 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2a647c1b-6cb3-4197-8351-810e31681aee tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:41.812929 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2a647c1b-6cb3-4197-8351-810e31681aee tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:41.851386 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e04d3b47-6b7e-4528-b0c1-4fd3c8015782 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:41.852005 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-e04d3b47-6b7e-4528-b0c1-4fd3c8015782 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] [instance: 8decdd22-7413-438f-94d0-5c3238a2072b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:41.859292 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e04d3b47-6b7e-4528-b0c1-4fd3c8015782 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:41.869175 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e04d3b47-6b7e-4528-b0c1-4fd3c8015782 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:41.869175 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e04d3b47-6b7e-4528-b0c1-4fd3c8015782 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:41.869175 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e04d3b47-6b7e-4528-b0c1-4fd3c8015782 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:42.171634 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-e04d3b47-6b7e-4528-b0c1-4fd3c8015782 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d78520e9c2483c94050fc91d9e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebd69a2ffc492eae05aaf62e2d8ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:42.174371 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2a647c1b-6cb3-4197-8351-810e31681aee tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:42.183676 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-e04d3b47-6b7e-4528-b0c1-4fd3c8015782 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] 10.222.0.45 "GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b" status: 200 len: 1315 microversion: 2.1 time: 0.335634 Jun 17 11:41:42.183958 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2a647c1b-6cb3-4197-8351-810e31681aee tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1364 microversion: 2.1 time: 0.383447 Jun 17 11:41:42.184057 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 35/74] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:41 2022] GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:42.185288 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 40/75] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:41 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1364 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:42.190190 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1855b578-635b-4a7f-86d9-fac77c521420 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:42.191001 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-1855b578-635b-4a7f-86d9-fac77c521420 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:42.197898 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1855b578-635b-4a7f-86d9-fac77c521420 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:42.198698 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1855b578-635b-4a7f-86d9-fac77c521420 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:42.199743 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1855b578-635b-4a7f-86d9-fac77c521420 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:42.200394 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1855b578-635b-4a7f-86d9-fac77c521420 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:42.209275 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-40e89c87-1fed-4b15-9609-154c37da194a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:42.211194 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-40e89c87-1fed-4b15-9609-154c37da194a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:42.233056 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-40e89c87-1fed-4b15-9609-154c37da194a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:42.233498 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-40e89c87-1fed-4b15-9609-154c37da194a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:42.236816 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-40e89c87-1fed-4b15-9609-154c37da194a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:42.237397 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-40e89c87-1fed-4b15-9609-154c37da194a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:42.643310 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-1855b578-635b-4a7f-86d9-fac77c521420 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:42.655130 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-1855b578-635b-4a7f-86d9-fac77c521420 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1321 microversion: 2.1 time: 0.468588 Jun 17 11:41:42.655987 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 41/76] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:42 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1321 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:42.661574 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-40e89c87-1fed-4b15-9609-154c37da194a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:42.662377 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-7748a2b3-d194-49a5-b18e-65abfd0407ff req-a499507e-5231-4b10-8568-f28d68bc0f66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be48aa4e-115e-4d58-8940-f722120f4664", "tag": "8539e658-97e4-4b54-88b0-968fec4fe3fa"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:41:42.671653 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-7748a2b3-d194-49a5-b18e-65abfd0407ff req-a499507e-5231-4b10-8568-f28d68bc0f66 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:42.672057 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-7748a2b3-d194-49a5-b18e-65abfd0407ff req-a499507e-5231-4b10-8568-f28d68bc0f66 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:42.678134 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-40e89c87-1fed-4b15-9609-154c37da194a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:42.681698 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-40e89c87-1fed-4b15-9609-154c37da194a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:42.683844 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-40e89c87-1fed-4b15-9609-154c37da194a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1407 microversion: 2.20 time: 0.490099 Jun 17 11:41:42.684866 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-7748a2b3-d194-49a5-b18e-65abfd0407ff req-a499507e-5231-4b10-8568-f28d68bc0f66 service nova] Creating event network-changed:8539e658-97e4-4b54-88b0-968fec4fe3fa for instance be48aa4e-115e-4d58-8940-f722120f4664 on hv-cinder-83716 Jun 17 11:41:42.685275 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 36/77] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:41:42 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1407 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:41:42.690813 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-7748a2b3-d194-49a5-b18e-65abfd0407ff req-a499507e-5231-4b10-8568-f28d68bc0f66 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033452 Jun 17 11:41:42.691469 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 42/78] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:41:42.697193 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-3fb18823-884a-4fb0-b198-d1d7d5489a50 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:42.698701 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-3fb18823-884a-4fb0-b198-d1d7d5489a50 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: be48aa4e-115e-4d58-8940-f722120f4664] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:42.723162 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3fb18823-884a-4fb0-b198-d1d7d5489a50 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:42.723162 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3fb18823-884a-4fb0-b198-d1d7d5489a50 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:42.723162 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3fb18823-884a-4fb0-b198-d1d7d5489a50 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:42.723162 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3fb18823-884a-4fb0-b198-d1d7d5489a50 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:42.970312 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-3fb18823-884a-4fb0-b198-d1d7d5489a50 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:42.978916 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-3fb18823-884a-4fb0-b198-d1d7d5489a50 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664" status: 200 len: 1366 microversion: 2.1 time: 0.291668 Jun 17 11:41:42.980158 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 37/79] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:42 2022] GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664 => generated 1366 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:43.208074 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4d674420-8a3d-4a00-bb03-80de453334fa tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:43.209151 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-547672c8-8aec-40aa-ab8b-6ec954b85477 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:43.211305 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4d674420-8a3d-4a00-bb03-80de453334fa tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:43.214503 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-547672c8-8aec-40aa-ab8b-6ec954b85477 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] [instance: 8decdd22-7413-438f-94d0-5c3238a2072b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:43.233700 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-547672c8-8aec-40aa-ab8b-6ec954b85477 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:43.236719 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-547672c8-8aec-40aa-ab8b-6ec954b85477 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:43.239748 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-547672c8-8aec-40aa-ab8b-6ec954b85477 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:43.254491 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-547672c8-8aec-40aa-ab8b-6ec954b85477 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:43.269624 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4d674420-8a3d-4a00-bb03-80de453334fa tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:43.270431 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4d674420-8a3d-4a00-bb03-80de453334fa tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:43.271862 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4d674420-8a3d-4a00-bb03-80de453334fa tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:43.272894 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4d674420-8a3d-4a00-bb03-80de453334fa tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:43.765166 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=4 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:41:44.098608 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-547672c8-8aec-40aa-ab8b-6ec954b85477 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d78520e9c2483c94050fc91d9e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebd69a2ffc492eae05aaf62e2d8ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:44.116910 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-547672c8-8aec-40aa-ab8b-6ec954b85477 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] 10.222.0.45 "GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b" status: 200 len: 1315 microversion: 2.1 time: 0.917880 Jun 17 11:41:44.127840 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 43/80] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:43 2022] GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b => generated 1315 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:44.150176 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f9c1a49d-36c1-4e89-a5c8-2bb6f080b815 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:44.151125 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f9c1a49d-36c1-4e89-a5c8-2bb6f080b815 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:44.162389 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f9c1a49d-36c1-4e89-a5c8-2bb6f080b815 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:44.163552 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f9c1a49d-36c1-4e89-a5c8-2bb6f080b815 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:44.164482 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f9c1a49d-36c1-4e89-a5c8-2bb6f080b815 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:44.165571 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f9c1a49d-36c1-4e89-a5c8-2bb6f080b815 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:44.199062 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-4d674420-8a3d-4a00-bb03-80de453334fa tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:44.214241 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4d674420-8a3d-4a00-bb03-80de453334fa tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1364 microversion: 2.1 time: 1.012720 Jun 17 11:41:44.215036 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 38/81] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:43 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1364 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:44.230393 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-01af73e5-5ea6-4169-a8f4-26fb59e113c5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:44.231269 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-01af73e5-5ea6-4169-a8f4-26fb59e113c5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:44.246434 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-01af73e5-5ea6-4169-a8f4-26fb59e113c5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:44.250761 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-01af73e5-5ea6-4169-a8f4-26fb59e113c5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:44.253646 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-01af73e5-5ea6-4169-a8f4-26fb59e113c5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:44.267397 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-01af73e5-5ea6-4169-a8f4-26fb59e113c5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:44.267397 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=8 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:41:44.791092 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-01af73e5-5ea6-4169-a8f4-26fb59e113c5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:44.832510 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-01af73e5-5ea6-4169-a8f4-26fb59e113c5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:44.836207 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-01af73e5-5ea6-4169-a8f4-26fb59e113c5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:44.841804 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-01af73e5-5ea6-4169-a8f4-26fb59e113c5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1407 microversion: 2.20 time: 0.617190 Jun 17 11:41:44.864366 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f9c1a49d-36c1-4e89-a5c8-2bb6f080b815 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:44.870860 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 39/82] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:41:44 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1407 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:41:44.887628 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-7c41299c-d2b3-4b93-9883-4e23be9c4e6e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:44.888907 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-7c41299c-d2b3-4b93-9883-4e23be9c4e6e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: be48aa4e-115e-4d58-8940-f722120f4664] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:44.891954 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f9c1a49d-36c1-4e89-a5c8-2bb6f080b815 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1321 microversion: 2.1 time: 0.757874 Jun 17 11:41:44.893000 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 44/83] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:44 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1321 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:44.903292 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7c41299c-d2b3-4b93-9883-4e23be9c4e6e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:44.903773 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7c41299c-d2b3-4b93-9883-4e23be9c4e6e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:44.904620 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7c41299c-d2b3-4b93-9883-4e23be9c4e6e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:44.905058 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7c41299c-d2b3-4b93-9883-4e23be9c4e6e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:45.045431 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=8 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:41:45.216937 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-7c41299c-d2b3-4b93-9883-4e23be9c4e6e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:45.228501 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-7c41299c-d2b3-4b93-9883-4e23be9c4e6e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664" status: 200 len: 1366 microversion: 2.1 time: 0.354059 Jun 17 11:41:45.242197 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 40/84] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:44 2022] GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664 => generated 1366 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:45.252612 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-fb67c124-d75c-4519-8c11-ab5595828260 req-5672da3d-3c69-421c-975a-7931c78b263b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71050501-8f84-4701-a013-bfc7a4459972", "tag": "4f9d2fad-e808-44df-adda-539bddcec93d"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:41:45.267880 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-fb67c124-d75c-4519-8c11-ab5595828260 req-5672da3d-3c69-421c-975a-7931c78b263b service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:45.268608 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-fb67c124-d75c-4519-8c11-ab5595828260 req-5672da3d-3c69-421c-975a-7931c78b263b service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:45.298103 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-fb67c124-d75c-4519-8c11-ab5595828260 req-5672da3d-3c69-421c-975a-7931c78b263b service nova] Creating event network-changed:4f9d2fad-e808-44df-adda-539bddcec93d for instance 71050501-8f84-4701-a013-bfc7a4459972 on hv-cinder-83716 Jun 17 11:41:45.304612 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-fb67c124-d75c-4519-8c11-ab5595828260 req-5672da3d-3c69-421c-975a-7931c78b263b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060095 Jun 17 11:41:45.305633 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 41/85] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:41:45.312796 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-21e31e3c-c2c7-41c8-8ac5-cdf73a34cbb5 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:45.313708 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-21e31e3c-c2c7-41c8-8ac5-cdf73a34cbb5 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] [instance: 8decdd22-7413-438f-94d0-5c3238a2072b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:45.321321 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-21e31e3c-c2c7-41c8-8ac5-cdf73a34cbb5 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:45.321680 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-21e31e3c-c2c7-41c8-8ac5-cdf73a34cbb5 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:45.322470 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-21e31e3c-c2c7-41c8-8ac5-cdf73a34cbb5 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:45.323076 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-21e31e3c-c2c7-41c8-8ac5-cdf73a34cbb5 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:45.365535 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-ac1d51a8-8725-4c1f-8963-dbd1e7a85c99 req-5b3a1bd7-b57c-4db6-876e-e56ae8b1e258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8cd69a4-437d-4db2-bd02-b485b06773e2", "name": "network-vif-plugged", "status": "completed", "tag": "c8a5211f-0d5a-4f8f-a4a6-9d9fe6173ce8"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:41:45.379273 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-ac1d51a8-8725-4c1f-8963-dbd1e7a85c99 req-5b3a1bd7-b57c-4db6-876e-e56ae8b1e258 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:45.380346 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-ac1d51a8-8725-4c1f-8963-dbd1e7a85c99 req-5b3a1bd7-b57c-4db6-876e-e56ae8b1e258 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:45.401436 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-ac1d51a8-8725-4c1f-8963-dbd1e7a85c99 req-5b3a1bd7-b57c-4db6-876e-e56ae8b1e258 service nova] Creating event network-vif-plugged:c8a5211f-0d5a-4f8f-a4a6-9d9fe6173ce8 for instance b8cd69a4-437d-4db2-bd02-b485b06773e2 on hv-cinder-83716 Jun 17 11:41:45.407105 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-ac1d51a8-8725-4c1f-8963-dbd1e7a85c99 req-5b3a1bd7-b57c-4db6-876e-e56ae8b1e258 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.509718 Jun 17 11:41:45.408630 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 45/86] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:41:45.415914 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-7d83f067-4f92-4de4-8536-60a997da47fb tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:45.416621 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7d83f067-4f92-4de4-8536-60a997da47fb tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:45.424255 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7d83f067-4f92-4de4-8536-60a997da47fb tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:45.424951 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7d83f067-4f92-4de4-8536-60a997da47fb tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:45.426977 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7d83f067-4f92-4de4-8536-60a997da47fb tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:45.427667 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7d83f067-4f92-4de4-8536-60a997da47fb tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:45.581149 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-21e31e3c-c2c7-41c8-8ac5-cdf73a34cbb5 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d78520e9c2483c94050fc91d9e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebd69a2ffc492eae05aaf62e2d8ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:45.598115 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-21e31e3c-c2c7-41c8-8ac5-cdf73a34cbb5 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] 10.222.0.45 "GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b" status: 200 len: 1315 microversion: 2.1 time: 0.290396 Jun 17 11:41:45.599615 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 42/87] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:45 2022] GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:45.655553 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7d83f067-4f92-4de4-8536-60a997da47fb tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:45.661293 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-7d83f067-4f92-4de4-8536-60a997da47fb tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1364 microversion: 2.1 time: 0.251373 Jun 17 11:41:45.661894 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 46/88] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:45 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1364 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:45.869677 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a5d3d548-ac13-4d33-9880-0c98efe4528e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:45.870344 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a5d3d548-ac13-4d33-9880-0c98efe4528e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:45.888802 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a5d3d548-ac13-4d33-9880-0c98efe4528e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:45.889688 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a5d3d548-ac13-4d33-9880-0c98efe4528e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:45.890827 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a5d3d548-ac13-4d33-9880-0c98efe4528e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:45.891529 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a5d3d548-ac13-4d33-9880-0c98efe4528e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:45.909956 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-37581ff5-9130-4712-b5fc-2ea76dd0fdf3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:45.910856 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-37581ff5-9130-4712-b5fc-2ea76dd0fdf3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:45.918580 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-37581ff5-9130-4712-b5fc-2ea76dd0fdf3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:45.920033 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-37581ff5-9130-4712-b5fc-2ea76dd0fdf3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:45.921749 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-37581ff5-9130-4712-b5fc-2ea76dd0fdf3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:45.922543 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-37581ff5-9130-4712-b5fc-2ea76dd0fdf3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:46.380754 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-37581ff5-9130-4712-b5fc-2ea76dd0fdf3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:46.384523 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a5d3d548-ac13-4d33-9880-0c98efe4528e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:46.405887 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a5d3d548-ac13-4d33-9880-0c98efe4528e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:46.405887 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a5d3d548-ac13-4d33-9880-0c98efe4528e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:46.405887 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a5d3d548-ac13-4d33-9880-0c98efe4528e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1407 microversion: 2.20 time: 0.537321 Jun 17 11:41:46.406344 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 43/89] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:41:45 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1407 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:41:46.409288 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-37581ff5-9130-4712-b5fc-2ea76dd0fdf3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1321 microversion: 2.1 time: 0.489165 Jun 17 11:41:46.416326 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-7bb40aad-6762-4dbf-898f-14b8288ace5c tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:46.417303 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-7bb40aad-6762-4dbf-898f-14b8288ace5c tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: be48aa4e-115e-4d58-8940-f722120f4664] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:46.421423 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 47/90] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:45 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1321 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:46.434986 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7bb40aad-6762-4dbf-898f-14b8288ace5c tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:46.435639 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7bb40aad-6762-4dbf-898f-14b8288ace5c tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:46.436558 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7bb40aad-6762-4dbf-898f-14b8288ace5c tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:46.437672 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7bb40aad-6762-4dbf-898f-14b8288ace5c tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:46.622690 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4d52685d-ed3c-46b3-a28b-540236d50fda tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:46.623622 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4d52685d-ed3c-46b3-a28b-540236d50fda tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] [instance: 8decdd22-7413-438f-94d0-5c3238a2072b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:46.641406 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4d52685d-ed3c-46b3-a28b-540236d50fda tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:46.646706 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4d52685d-ed3c-46b3-a28b-540236d50fda tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:46.649415 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4d52685d-ed3c-46b3-a28b-540236d50fda tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:46.651066 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4d52685d-ed3c-46b3-a28b-540236d50fda tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:46.664766 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=100 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:41:46.994099 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-7bb40aad-6762-4dbf-898f-14b8288ace5c tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:47.006399 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4d52685d-ed3c-46b3-a28b-540236d50fda tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d78520e9c2483c94050fc91d9e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebd69a2ffc492eae05aaf62e2d8ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:47.006982 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-7bb40aad-6762-4dbf-898f-14b8288ace5c tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664" status: 200 len: 1366 microversion: 2.1 time: 0.603467 Jun 17 11:41:47.008457 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 44/91] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:46 2022] GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664 => generated 1366 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:47.013721 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b60fc375-a6e9-44f6-9f70-611580b08aed tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:47.014421 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b60fc375-a6e9-44f6-9f70-611580b08aed tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:47.016533 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4d52685d-ed3c-46b3-a28b-540236d50fda tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] 10.222.0.45 "GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b" status: 200 len: 1315 microversion: 2.1 time: 0.400754 Jun 17 11:41:47.017639 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 48/92] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:46 2022] GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:47.021114 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b60fc375-a6e9-44f6-9f70-611580b08aed tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:47.021577 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b60fc375-a6e9-44f6-9f70-611580b08aed tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:47.022355 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b60fc375-a6e9-44f6-9f70-611580b08aed tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:47.023827 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b60fc375-a6e9-44f6-9f70-611580b08aed tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:47.270715 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b60fc375-a6e9-44f6-9f70-611580b08aed tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:47.286621 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b60fc375-a6e9-44f6-9f70-611580b08aed tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1364 microversion: 2.1 time: 0.276369 Jun 17 11:41:47.287546 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 45/93] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:47 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1364 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:47.426657 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-05f07f0f-df23-43ea-8e4c-0f82b7481c3a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:47.427662 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-05f07f0f-df23-43ea-8e4c-0f82b7481c3a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:47.439193 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-05f07f0f-df23-43ea-8e4c-0f82b7481c3a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:47.440864 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-05f07f0f-df23-43ea-8e4c-0f82b7481c3a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:47.441296 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-05f07f0f-df23-43ea-8e4c-0f82b7481c3a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:47.441909 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c7e4fdcc-850b-4583-9bd0-00ea54cc56e1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:47.442672 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-05f07f0f-df23-43ea-8e4c-0f82b7481c3a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:47.445332 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c7e4fdcc-850b-4583-9bd0-00ea54cc56e1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:47.464472 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c7e4fdcc-850b-4583-9bd0-00ea54cc56e1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:47.465954 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c7e4fdcc-850b-4583-9bd0-00ea54cc56e1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:47.469156 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c7e4fdcc-850b-4583-9bd0-00ea54cc56e1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:47.470216 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c7e4fdcc-850b-4583-9bd0-00ea54cc56e1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:47.997237 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c7e4fdcc-850b-4583-9bd0-00ea54cc56e1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:48.010777 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=100 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:41:48.028091 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c7e4fdcc-850b-4583-9bd0-00ea54cc56e1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1321 microversion: 2.1 time: 0.591390 Jun 17 11:41:48.040372 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 46/94] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:47 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1321 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:41:48.050758 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-ccf22c4a-0049-4275-a536-1227931d0674 req-16acf699-2208-47f6-b136-36d240ba7143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8decdd22-7413-438f-94d0-5c3238a2072b", "name": "network-vif-plugged", "status": "completed", "tag": "199985a1-d517-4233-be02-8ddb17816c27"}, {"server_uuid": "39a1319f-9f84-46db-9981-30ff7e4acc74", "name": "network-vif-plugged", "status": "completed", "tag": "845a8d6f-82d9-4eca-a43c-35be0c12da3d"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:41:48.060385 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-05f07f0f-df23-43ea-8e4c-0f82b7481c3a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:48.062343 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-ccf22c4a-0049-4275-a536-1227931d0674 req-16acf699-2208-47f6-b136-36d240ba7143 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:48.063000 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-ccf22c4a-0049-4275-a536-1227931d0674 req-16acf699-2208-47f6-b136-36d240ba7143 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:48.072242 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-05f07f0f-df23-43ea-8e4c-0f82b7481c3a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:48.073851 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-05f07f0f-df23-43ea-8e4c-0f82b7481c3a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:48.078566 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-05f07f0f-df23-43ea-8e4c-0f82b7481c3a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1407 microversion: 2.20 time: 0.658734 Jun 17 11:41:48.080025 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 49/95] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:41:47 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1407 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:41:48.091209 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-ccf22c4a-0049-4275-a536-1227931d0674 req-16acf699-2208-47f6-b136-36d240ba7143 service nova] Creating event network-vif-plugged:199985a1-d517-4233-be02-8ddb17816c27 for instance 8decdd22-7413-438f-94d0-5c3238a2072b on hv-cinder-83716 Jun 17 11:41:48.091963 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-ccf22c4a-0049-4275-a536-1227931d0674 req-16acf699-2208-47f6-b136-36d240ba7143 service nova] Creating event network-vif-plugged:845a8d6f-82d9-4eca-a43c-35be0c12da3d for instance 39a1319f-9f84-46db-9981-30ff7e4acc74 on hv-cinder-83716 Jun 17 11:41:48.092093 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-7c35688a-9f25-45c6-93c7-2abceeca03b9 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:48.092721 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7c35688a-9f25-45c6-93c7-2abceeca03b9 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] [instance: 8decdd22-7413-438f-94d0-5c3238a2072b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:48.099771 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-ccf22c4a-0049-4275-a536-1227931d0674 req-16acf699-2208-47f6-b136-36d240ba7143 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.057691 Jun 17 11:41:48.100861 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 47/96] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:41:48.107403 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c025c671-222b-4723-8a92-c68ab9ed6c24 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:48.107911 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7c35688a-9f25-45c6-93c7-2abceeca03b9 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:48.108736 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c025c671-222b-4723-8a92-c68ab9ed6c24 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: be48aa4e-115e-4d58-8940-f722120f4664] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:48.110201 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7c35688a-9f25-45c6-93c7-2abceeca03b9 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:48.112667 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7c35688a-9f25-45c6-93c7-2abceeca03b9 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:48.116010 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c025c671-222b-4723-8a92-c68ab9ed6c24 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:48.117247 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c025c671-222b-4723-8a92-c68ab9ed6c24 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:48.118175 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c025c671-222b-4723-8a92-c68ab9ed6c24 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:48.118760 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c025c671-222b-4723-8a92-c68ab9ed6c24 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:48.125307 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7c35688a-9f25-45c6-93c7-2abceeca03b9 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:48.365812 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c025c671-222b-4723-8a92-c68ab9ed6c24 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:48.380501 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c025c671-222b-4723-8a92-c68ab9ed6c24 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664" status: 200 len: 1366 microversion: 2.1 time: 0.274901 Jun 17 11:41:48.380643 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7c35688a-9f25-45c6-93c7-2abceeca03b9 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d78520e9c2483c94050fc91d9e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebd69a2ffc492eae05aaf62e2d8ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:48.380761 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 48/97] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:48 2022] GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664 => generated 1366 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:48.385177 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0aa8f815-68b3-4b9e-9adc-374ee4d8bd71 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:48.385787 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0aa8f815-68b3-4b9e-9adc-374ee4d8bd71 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:48.386901 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-7c35688a-9f25-45c6-93c7-2abceeca03b9 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] 10.222.0.45 "GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b" status: 200 len: 1315 microversion: 2.1 time: 0.305270 Jun 17 11:41:48.393314 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0aa8f815-68b3-4b9e-9adc-374ee4d8bd71 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:48.393984 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 50/98] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:48 2022] GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:48.394200 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0aa8f815-68b3-4b9e-9adc-374ee4d8bd71 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:48.395196 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0aa8f815-68b3-4b9e-9adc-374ee4d8bd71 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:48.395814 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0aa8f815-68b3-4b9e-9adc-374ee4d8bd71 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:48.549644 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0aa8f815-68b3-4b9e-9adc-374ee4d8bd71 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:48.561921 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0aa8f815-68b3-4b9e-9adc-374ee4d8bd71 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1364 microversion: 2.1 time: 0.182375 Jun 17 11:41:48.562618 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 49/99] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:48 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:49.053765 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-9794ad28-2865-4380-b7da-c3f15fe4513b tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:49.054261 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-9794ad28-2865-4380-b7da-c3f15fe4513b tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:49.060485 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9794ad28-2865-4380-b7da-c3f15fe4513b tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:49.063105 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9794ad28-2865-4380-b7da-c3f15fe4513b tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:49.063105 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9794ad28-2865-4380-b7da-c3f15fe4513b tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:49.063105 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9794ad28-2865-4380-b7da-c3f15fe4513b tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:49.097222 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ccf0bf55-d030-4a10-a170-6d30dc1bb3e3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:49.097774 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-ccf0bf55-d030-4a10-a170-6d30dc1bb3e3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:49.110720 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ccf0bf55-d030-4a10-a170-6d30dc1bb3e3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:49.111514 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ccf0bf55-d030-4a10-a170-6d30dc1bb3e3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:49.112513 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ccf0bf55-d030-4a10-a170-6d30dc1bb3e3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:49.113165 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ccf0bf55-d030-4a10-a170-6d30dc1bb3e3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:49.340345 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-9794ad28-2865-4380-b7da-c3f15fe4513b tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:49.349090 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-9794ad28-2865-4380-b7da-c3f15fe4513b tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1321 microversion: 2.1 time: 0.299248 Jun 17 11:41:49.350657 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 51/100] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:49 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1321 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:49.370812 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ccf0bf55-d030-4a10-a170-6d30dc1bb3e3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:49.379539 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ccf0bf55-d030-4a10-a170-6d30dc1bb3e3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:49.381088 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ccf0bf55-d030-4a10-a170-6d30dc1bb3e3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:49.382604 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-ccf0bf55-d030-4a10-a170-6d30dc1bb3e3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1407 microversion: 2.20 time: 0.289116 Jun 17 11:41:49.383318 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 50/101] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:41:49 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1407 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:41:49.406157 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-41eabab0-8913-46bf-a95f-9ec777c59642 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:49.407112 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-41eabab0-8913-46bf-a95f-9ec777c59642 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: be48aa4e-115e-4d58-8940-f722120f4664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:49.409115 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-fe0d317d-ce4e-47e8-8612-2bbb75402baf tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:49.409723 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-fe0d317d-ce4e-47e8-8612-2bbb75402baf tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] [instance: 8decdd22-7413-438f-94d0-5c3238a2072b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:49.417052 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-41eabab0-8913-46bf-a95f-9ec777c59642 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:49.417052 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-41eabab0-8913-46bf-a95f-9ec777c59642 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:49.417340 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fe0d317d-ce4e-47e8-8612-2bbb75402baf tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:49.417480 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-41eabab0-8913-46bf-a95f-9ec777c59642 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:49.417615 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fe0d317d-ce4e-47e8-8612-2bbb75402baf tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:49.418032 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-41eabab0-8913-46bf-a95f-9ec777c59642 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:49.418208 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fe0d317d-ce4e-47e8-8612-2bbb75402baf tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:49.418493 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fe0d317d-ce4e-47e8-8612-2bbb75402baf tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:49.634373 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-fe0d317d-ce4e-47e8-8612-2bbb75402baf tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d78520e9c2483c94050fc91d9e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebd69a2ffc492eae05aaf62e2d8ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:49.635043 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-41eabab0-8913-46bf-a95f-9ec777c59642 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:49.646276 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-fe0d317d-ce4e-47e8-8612-2bbb75402baf tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] 10.222.0.45 "GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b" status: 200 len: 1315 microversion: 2.1 time: 0.241837 Jun 17 11:41:49.655405 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-41eabab0-8913-46bf-a95f-9ec777c59642 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664" status: 200 len: 1366 microversion: 2.1 time: 0.257895 Jun 17 11:41:49.657505 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 51/102] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:49 2022] GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:41:49.663628 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8f56bae7-26ff-4732-a6f0-ef8b46fea199 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:49.664788 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-8f56bae7-26ff-4732-a6f0-ef8b46fea199 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:49.671547 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8f56bae7-26ff-4732-a6f0-ef8b46fea199 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:49.675122 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8f56bae7-26ff-4732-a6f0-ef8b46fea199 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:49.675122 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8f56bae7-26ff-4732-a6f0-ef8b46fea199 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:49.675122 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8f56bae7-26ff-4732-a6f0-ef8b46fea199 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:49.687972 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 52/103] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:49 2022] GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664 => generated 1366 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:49.883420 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-8f56bae7-26ff-4732-a6f0-ef8b46fea199 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:49.891261 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-8f56bae7-26ff-4732-a6f0-ef8b46fea199 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1550 microversion: 2.1 time: 0.232485 Jun 17 11:41:49.891905 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 52/104] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:49 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1550 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:49.910210 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5cb6be32-c778-4236-8de6-538819b81412 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:49.911296 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-5cb6be32-c778-4236-8de6-538819b81412 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:49.920520 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5cb6be32-c778-4236-8de6-538819b81412 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:49.921207 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5cb6be32-c778-4236-8de6-538819b81412 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:49.922116 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5cb6be32-c778-4236-8de6-538819b81412 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:49.922648 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5cb6be32-c778-4236-8de6-538819b81412 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:50.120848 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-11f7d1a0-14f2-4135-b5ca-2a875df79f6d req-82680997-94c6-4a5d-ae7c-ac229eba6364 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76c24c0d-60e5-45e5-afeb-d8595d5116f5", "name": "network-vif-plugged", "status": "completed", "tag": "fbcdaa75-cd33-46e4-a7fd-57c88e44b5b6"}, {"server_uuid": "be48aa4e-115e-4d58-8940-f722120f4664", "name": "network-vif-plugged", "status": "completed", "tag": "8539e658-97e4-4b54-88b0-968fec4fe3fa"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:41:50.130310 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-11f7d1a0-14f2-4135-b5ca-2a875df79f6d req-82680997-94c6-4a5d-ae7c-ac229eba6364 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:50.130743 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-11f7d1a0-14f2-4135-b5ca-2a875df79f6d req-82680997-94c6-4a5d-ae7c-ac229eba6364 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:50.141288 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5cb6be32-c778-4236-8de6-538819b81412 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.236057 Jun 17 11:41:50.142792 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 53/105] 10.222.0.45 () {58 vars in 1274 bytes} [Fri Jun 17 11:41:49 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2/os-interface => generated 285 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:41:50.151268 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-11f7d1a0-14f2-4135-b5ca-2a875df79f6d req-82680997-94c6-4a5d-ae7c-ac229eba6364 service nova] Creating event network-vif-plugged:fbcdaa75-cd33-46e4-a7fd-57c88e44b5b6 for instance 76c24c0d-60e5-45e5-afeb-d8595d5116f5 on hv-cinder-83716 Jun 17 11:41:50.152621 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-11f7d1a0-14f2-4135-b5ca-2a875df79f6d req-82680997-94c6-4a5d-ae7c-ac229eba6364 service nova] Creating event network-vif-plugged:8539e658-97e4-4b54-88b0-968fec4fe3fa for instance be48aa4e-115e-4d58-8940-f722120f4664 on hv-cinder-83716 Jun 17 11:41:50.158378 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-11f7d1a0-14f2-4135-b5ca-2a875df79f6d req-82680997-94c6-4a5d-ae7c-ac229eba6364 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042157 Jun 17 11:41:50.159312 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 53/106] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:41:50.369574 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5f63edaa-4436-4ffd-a55b-330093059cab tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:50.370260 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-5f63edaa-4436-4ffd-a55b-330093059cab tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:50.385519 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5f63edaa-4436-4ffd-a55b-330093059cab tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:50.386016 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5f63edaa-4436-4ffd-a55b-330093059cab tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:50.389179 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5f63edaa-4436-4ffd-a55b-330093059cab tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:50.390500 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5f63edaa-4436-4ffd-a55b-330093059cab tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:50.403894 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9e1826e6-9494-4e73-8306-e0489ffcfb9d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:50.404983 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9e1826e6-9494-4e73-8306-e0489ffcfb9d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:50.428693 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9e1826e6-9494-4e73-8306-e0489ffcfb9d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:50.431678 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9e1826e6-9494-4e73-8306-e0489ffcfb9d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:50.434890 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9e1826e6-9494-4e73-8306-e0489ffcfb9d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:50.435818 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9e1826e6-9494-4e73-8306-e0489ffcfb9d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:50.815982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5f63edaa-4436-4ffd-a55b-330093059cab tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:50.825266 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5f63edaa-4436-4ffd-a55b-330093059cab tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1321 microversion: 2.1 time: 0.461161 Jun 17 11:41:50.826214 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 54/107] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:50 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1321 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:50.831481 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-352d4337-c468-4523-abe0-dc44fb20564d tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:50.833676 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-352d4337-c468-4523-abe0-dc44fb20564d tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] [instance: 8decdd22-7413-438f-94d0-5c3238a2072b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:50.840946 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-352d4337-c468-4523-abe0-dc44fb20564d tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:50.841609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-352d4337-c468-4523-abe0-dc44fb20564d tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:50.842532 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-352d4337-c468-4523-abe0-dc44fb20564d tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:50.843115 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-352d4337-c468-4523-abe0-dc44fb20564d tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:50.950961 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9e1826e6-9494-4e73-8306-e0489ffcfb9d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:50.960337 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9e1826e6-9494-4e73-8306-e0489ffcfb9d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:50.962817 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9e1826e6-9494-4e73-8306-e0489ffcfb9d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:50.964155 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9e1826e6-9494-4e73-8306-e0489ffcfb9d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1407 microversion: 2.20 time: 0.566182 Jun 17 11:41:50.966622 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 54/108] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:41:50 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1407 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:41:50.971517 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-5812c1eb-a93f-42e5-b49a-8e21dae9af5e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:50.981911 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-5812c1eb-a93f-42e5-b49a-8e21dae9af5e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: be48aa4e-115e-4d58-8940-f722120f4664] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:50.981911 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5812c1eb-a93f-42e5-b49a-8e21dae9af5e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:50.981911 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5812c1eb-a93f-42e5-b49a-8e21dae9af5e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:50.981911 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5812c1eb-a93f-42e5-b49a-8e21dae9af5e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:50.982418 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5812c1eb-a93f-42e5-b49a-8e21dae9af5e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:51.549832 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-352d4337-c468-4523-abe0-dc44fb20564d tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d78520e9c2483c94050fc91d9e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebd69a2ffc492eae05aaf62e2d8ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:51.561665 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-352d4337-c468-4523-abe0-dc44fb20564d tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] 10.222.0.45 "GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b" status: 200 len: 1315 microversion: 2.1 time: 0.733759 Jun 17 11:41:51.562583 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5812c1eb-a93f-42e5-b49a-8e21dae9af5e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:51.563499 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 55/109] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:50 2022] GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b => generated 1315 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:51.576718 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-5812c1eb-a93f-42e5-b49a-8e21dae9af5e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664" status: 200 len: 1366 microversion: 2.1 time: 0.608668 Jun 17 11:41:51.577420 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 55/110] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:50 2022] GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664 => generated 1366 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:51.850457 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8486d022-9917-492c-ba21-1bbc0298572b tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:51.851997 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-8486d022-9917-492c-ba21-1bbc0298572b tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:51.860148 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8486d022-9917-492c-ba21-1bbc0298572b tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:51.860892 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8486d022-9917-492c-ba21-1bbc0298572b tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:51.862194 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8486d022-9917-492c-ba21-1bbc0298572b tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:51.864544 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8486d022-9917-492c-ba21-1bbc0298572b tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:51.988530 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-04a8cf10-716b-4b58-823a-e040afbe6b27 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:51.988530 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-04a8cf10-716b-4b58-823a-e040afbe6b27 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:52.017497 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-04a8cf10-716b-4b58-823a-e040afbe6b27 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:52.017944 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-04a8cf10-716b-4b58-823a-e040afbe6b27 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:52.024392 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-04a8cf10-716b-4b58-823a-e040afbe6b27 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:52.025138 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-04a8cf10-716b-4b58-823a-e040afbe6b27 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:52.362738 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-8486d022-9917-492c-ba21-1bbc0298572b tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:52.371059 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-8486d022-9917-492c-ba21-1bbc0298572b tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1321 microversion: 2.1 time: 0.524535 Jun 17 11:41:52.375263 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 56/111] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:51 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1321 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:52.453375 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-04a8cf10-716b-4b58-823a-e040afbe6b27 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:52.461911 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-04a8cf10-716b-4b58-823a-e040afbe6b27 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:52.469512 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-04a8cf10-716b-4b58-823a-e040afbe6b27 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:52.470949 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-04a8cf10-716b-4b58-823a-e040afbe6b27 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1407 microversion: 2.20 time: 0.491626 Jun 17 11:41:52.476248 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 56/112] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:41:51 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1407 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:41:52.581358 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4157ed45-9c88-486b-adcd-3cc19e4576a8 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:52.582052 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4157ed45-9c88-486b-adcd-3cc19e4576a8 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] [instance: 8decdd22-7413-438f-94d0-5c3238a2072b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:52.590686 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4157ed45-9c88-486b-adcd-3cc19e4576a8 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:52.591144 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4157ed45-9c88-486b-adcd-3cc19e4576a8 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:52.591968 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4157ed45-9c88-486b-adcd-3cc19e4576a8 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:52.592410 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4157ed45-9c88-486b-adcd-3cc19e4576a8 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:52.594743 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4ac5f267-9daa-4be3-bfd6-6d62ecd27e01 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:52.596151 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4ac5f267-9daa-4be3-bfd6-6d62ecd27e01 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: be48aa4e-115e-4d58-8940-f722120f4664] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:52.609395 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4ac5f267-9daa-4be3-bfd6-6d62ecd27e01 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:52.610126 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4ac5f267-9daa-4be3-bfd6-6d62ecd27e01 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:52.611200 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4ac5f267-9daa-4be3-bfd6-6d62ecd27e01 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:52.612567 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4ac5f267-9daa-4be3-bfd6-6d62ecd27e01 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:52.910485 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4157ed45-9c88-486b-adcd-3cc19e4576a8 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d78520e9c2483c94050fc91d9e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebd69a2ffc492eae05aaf62e2d8ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:52.919937 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4157ed45-9c88-486b-adcd-3cc19e4576a8 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] 10.222.0.45 "GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b" status: 200 len: 1503 microversion: 2.1 time: 0.342506 Jun 17 11:41:52.931136 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 57/113] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:52 2022] GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b => generated 1503 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:52.931222 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-2335866b-e5bc-4efc-bd67-b35fd46c1814 req-78d0eb57-c7c3-4d6e-9b52-49711dfb8f3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8cd69a4-437d-4db2-bd02-b485b06773e2", "tag": "c8a5211f-0d5a-4f8f-a4a6-9d9fe6173ce8"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:41:52.945606 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-4ac5f267-9daa-4be3-bfd6-6d62ecd27e01 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:52.946937 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-2335866b-e5bc-4efc-bd67-b35fd46c1814 req-78d0eb57-c7c3-4d6e-9b52-49711dfb8f3a service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:52.947423 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-2335866b-e5bc-4efc-bd67-b35fd46c1814 req-78d0eb57-c7c3-4d6e-9b52-49711dfb8f3a service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:52.955433 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4ac5f267-9daa-4be3-bfd6-6d62ecd27e01 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664" status: 200 len: 1366 microversion: 2.1 time: 0.364897 Jun 17 11:41:52.956642 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 57/114] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:52 2022] GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664 => generated 1366 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:41:52.970437 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-2335866b-e5bc-4efc-bd67-b35fd46c1814 req-78d0eb57-c7c3-4d6e-9b52-49711dfb8f3a service nova] Creating event network-changed:c8a5211f-0d5a-4f8f-a4a6-9d9fe6173ce8 for instance b8cd69a4-437d-4db2-bd02-b485b06773e2 on hv-cinder-83716 Jun 17 11:41:52.980552 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-2335866b-e5bc-4efc-bd67-b35fd46c1814 req-78d0eb57-c7c3-4d6e-9b52-49711dfb8f3a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054268 Jun 17 11:41:52.981159 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 58/115] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:41:53.392334 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c9298ff1-b991-44b8-b3f6-5ff67bfc2f42 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:53.393970 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c9298ff1-b991-44b8-b3f6-5ff67bfc2f42 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:53.400936 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c9298ff1-b991-44b8-b3f6-5ff67bfc2f42 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:53.401631 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c9298ff1-b991-44b8-b3f6-5ff67bfc2f42 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:53.402613 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c9298ff1-b991-44b8-b3f6-5ff67bfc2f42 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:53.403060 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c9298ff1-b991-44b8-b3f6-5ff67bfc2f42 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:53.501202 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f0546505-9036-4edc-bb62-e689c5e134fc tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:53.502029 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f0546505-9036-4edc-bb62-e689c5e134fc tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:53.513609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f0546505-9036-4edc-bb62-e689c5e134fc tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:53.514165 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f0546505-9036-4edc-bb62-e689c5e134fc tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:53.514847 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f0546505-9036-4edc-bb62-e689c5e134fc tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:53.515319 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f0546505-9036-4edc-bb62-e689c5e134fc tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:53.770726 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c9298ff1-b991-44b8-b3f6-5ff67bfc2f42 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:53.796407 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c9298ff1-b991-44b8-b3f6-5ff67bfc2f42 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1321 microversion: 2.1 time: 0.407901 Jun 17 11:41:53.799689 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 58/116] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:53 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1321 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:53.808778 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f0546505-9036-4edc-bb62-e689c5e134fc tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:53.819709 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f0546505-9036-4edc-bb62-e689c5e134fc tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:53.827837 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f0546505-9036-4edc-bb62-e689c5e134fc tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:53.830871 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f0546505-9036-4edc-bb62-e689c5e134fc tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1407 microversion: 2.20 time: 0.333646 Jun 17 11:41:53.834000 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 59/117] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:41:53 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1407 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:41:53.981542 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-d5405336-7741-45f9-b955-fa31c9d513ab tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:53.981542 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-d5405336-7741-45f9-b955-fa31c9d513ab tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: be48aa4e-115e-4d58-8940-f722120f4664] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:53.985620 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-ccf760c8-e208-403d-b07e-874bc106c13d req-f075deb6-d635-4807-acab-3f5d1945e07a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71050501-8f84-4701-a013-bfc7a4459972", "name": "network-vif-plugged", "status": "completed", "tag": "4f9d2fad-e808-44df-adda-539bddcec93d"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:41:53.989776 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d5405336-7741-45f9-b955-fa31c9d513ab tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:53.990353 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d5405336-7741-45f9-b955-fa31c9d513ab tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:53.991207 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d5405336-7741-45f9-b955-fa31c9d513ab tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:53.991778 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d5405336-7741-45f9-b955-fa31c9d513ab tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:54.002168 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-ccf760c8-e208-403d-b07e-874bc106c13d req-f075deb6-d635-4807-acab-3f5d1945e07a service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:54.002750 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-ccf760c8-e208-403d-b07e-874bc106c13d req-f075deb6-d635-4807-acab-3f5d1945e07a service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:54.016083 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-ccf760c8-e208-403d-b07e-874bc106c13d req-f075deb6-d635-4807-acab-3f5d1945e07a service nova] Creating event network-vif-plugged:4f9d2fad-e808-44df-adda-539bddcec93d for instance 71050501-8f84-4701-a013-bfc7a4459972 on hv-cinder-83716 Jun 17 11:41:54.021514 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-ccf760c8-e208-403d-b07e-874bc106c13d req-f075deb6-d635-4807-acab-3f5d1945e07a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039659 Jun 17 11:41:54.022304 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 60/118] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:41:54.218420 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-d5405336-7741-45f9-b955-fa31c9d513ab tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:54.229319 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-d5405336-7741-45f9-b955-fa31c9d513ab tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664" status: 200 len: 1366 microversion: 2.1 time: 0.254882 Jun 17 11:41:54.230809 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 59/119] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:53 2022] GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664 => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:54.828724 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-987b3007-9154-499a-9639-fe71a3182788 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31c8c4ad-58c6-40e5-86be-036e6251f4f9"}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:41:54.833202 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-987b3007-9154-499a-9639-fe71a3182788 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] [instance: 8decdd22-7413-438f-94d0-5c3238a2072b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:54.833305 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-14376c7c-ede4-4eb4-b10a-9df9aeb74aa9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:54.834204 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-14376c7c-ede4-4eb4-b10a-9df9aeb74aa9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:54.836958 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:41:54.850471 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-14376c7c-ede4-4eb4-b10a-9df9aeb74aa9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:54.852579 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-987b3007-9154-499a-9639-fe71a3182788 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:54.853021 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-987b3007-9154-499a-9639-fe71a3182788 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:54.853807 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-987b3007-9154-499a-9639-fe71a3182788 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:54.854431 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-14376c7c-ede4-4eb4-b10a-9df9aeb74aa9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:54.855537 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-14376c7c-ede4-4eb4-b10a-9df9aeb74aa9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:54.855973 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-14376c7c-ede4-4eb4-b10a-9df9aeb74aa9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:54.860035 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-987b3007-9154-499a-9639-fe71a3182788 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:55.401608 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-14376c7c-ede4-4eb4-b10a-9df9aeb74aa9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:55.411597 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-14376c7c-ede4-4eb4-b10a-9df9aeb74aa9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1321 microversion: 2.1 time: 0.592084 Jun 17 11:41:55.412781 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 61/120] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:54 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1321 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:55.422062 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-71679a71-1ae2-4a4d-bc1d-64359247b865 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:55.422062 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-71679a71-1ae2-4a4d-bc1d-64359247b865 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:55.428770 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-71679a71-1ae2-4a4d-bc1d-64359247b865 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:55.429244 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-71679a71-1ae2-4a4d-bc1d-64359247b865 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:55.430548 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-71679a71-1ae2-4a4d-bc1d-64359247b865 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:55.430985 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-71679a71-1ae2-4a4d-bc1d-64359247b865 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:55.689460 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-71679a71-1ae2-4a4d-bc1d-64359247b865 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:55.700054 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-71679a71-1ae2-4a4d-bc1d-64359247b865 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:55.701931 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-71679a71-1ae2-4a4d-bc1d-64359247b865 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:55.703844 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-71679a71-1ae2-4a4d-bc1d-64359247b865 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1407 microversion: 2.20 time: 0.289676 Jun 17 11:41:55.704568 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 62/121] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:41:55 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1407 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:41:55.709558 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ad1ac4d3-5f5d-433b-a17c-300a992e7b76 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:55.713047 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ad1ac4d3-5f5d-433b-a17c-300a992e7b76 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: be48aa4e-115e-4d58-8940-f722120f4664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:55.718523 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ad1ac4d3-5f5d-433b-a17c-300a992e7b76 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:55.718939 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ad1ac4d3-5f5d-433b-a17c-300a992e7b76 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:55.719950 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ad1ac4d3-5f5d-433b-a17c-300a992e7b76 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:55.720576 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ad1ac4d3-5f5d-433b-a17c-300a992e7b76 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:55.915096 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ad1ac4d3-5f5d-433b-a17c-300a992e7b76 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:55.924875 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ad1ac4d3-5f5d-433b-a17c-300a992e7b76 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664" status: 200 len: 1555 microversion: 2.1 time: 0.219036 Jun 17 11:41:55.925498 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 63/122] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:55 2022] GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664 => generated 1555 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:55.948717 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-cdce3ad5-4e92-4f75-91b4-79c6f3f51e6a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:55.949215 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-cdce3ad5-4e92-4f75-91b4-79c6f3f51e6a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: be48aa4e-115e-4d58-8940-f722120f4664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:55.958097 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cdce3ad5-4e92-4f75-91b4-79c6f3f51e6a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:55.958546 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cdce3ad5-4e92-4f75-91b4-79c6f3f51e6a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:55.959352 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cdce3ad5-4e92-4f75-91b4-79c6f3f51e6a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:55.959823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cdce3ad5-4e92-4f75-91b4-79c6f3f51e6a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:56.064526 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-cdce3ad5-4e92-4f75-91b4-79c6f3f51e6a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.123264 Jun 17 11:41:56.072021 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 64/123] 10.222.0.45 () {58 vars in 1274 bytes} [Fri Jun 17 11:41:55 2022] GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:41:56.335010 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-987b3007-9154-499a-9639-fe71a3182788 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] 10.222.0.45 "POST /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.517428 Jun 17 11:41:56.337901 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 60/124] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jun 17 11:41:54 2022] POST /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b/os-volume_attachments => generated 194 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:41:56.431263 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8987d8d6-f85c-4c2b-8101-39160663d166 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:56.432026 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-8987d8d6-f85c-4c2b-8101-39160663d166 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:56.438159 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8987d8d6-f85c-4c2b-8101-39160663d166 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:56.438678 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8987d8d6-f85c-4c2b-8101-39160663d166 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:56.439552 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8987d8d6-f85c-4c2b-8101-39160663d166 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:56.440047 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8987d8d6-f85c-4c2b-8101-39160663d166 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:56.734042 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b58ea947-8d29-4a63-b2f3-db8c033a21a8 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:56.737812 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b58ea947-8d29-4a63-b2f3-db8c033a21a8 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:56.754580 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b58ea947-8d29-4a63-b2f3-db8c033a21a8 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:56.757258 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b58ea947-8d29-4a63-b2f3-db8c033a21a8 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:56.760522 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b58ea947-8d29-4a63-b2f3-db8c033a21a8 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:56.771228 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b58ea947-8d29-4a63-b2f3-db8c033a21a8 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:56.948211 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-8987d8d6-f85c-4c2b-8101-39160663d166 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:56.964060 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-8987d8d6-f85c-4c2b-8101-39160663d166 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1515 microversion: 2.1 time: 0.534790 Jun 17 11:41:56.965047 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 65/125] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:56 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1515 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:56.987016 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-357e3506-33a9-41f8-89e6-8269df6cedd9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:41:56.989316 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-357e3506-33a9-41f8-89e6-8269df6cedd9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:56.998171 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-357e3506-33a9-41f8-89e6-8269df6cedd9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:56.998851 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-357e3506-33a9-41f8-89e6-8269df6cedd9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:56.999859 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-357e3506-33a9-41f8-89e6-8269df6cedd9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:57.000522 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-357e3506-33a9-41f8-89e6-8269df6cedd9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:57.037447 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-357e3506-33a9-41f8-89e6-8269df6cedd9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lazy-loading 'flavor' on Instance uuid 76c24c0d-60e5-45e5-afeb-d8595d5116f5 {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:41:57.046337 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b58ea947-8d29-4a63-b2f3-db8c033a21a8 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:57.055584 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b58ea947-8d29-4a63-b2f3-db8c033a21a8 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:57.057624 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b58ea947-8d29-4a63-b2f3-db8c033a21a8 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:57.060009 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b58ea947-8d29-4a63-b2f3-db8c033a21a8 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1407 microversion: 2.20 time: 0.335122 Jun 17 11:41:57.073173 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 61/126] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:41:56 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1407 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:41:57.077241 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=100 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:41:57.510995 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-357e3506-33a9-41f8-89e6-8269df6cedd9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "POST /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5/action" status: 200 len: 32 microversion: 2.1 time: 0.529545 Jun 17 11:41:57.513737 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 66/127] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jun 17 11:41:56 2022] POST /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5/action => generated 32 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 11:41:57.523284 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b7a6ef6e-c035-4014-ae1a-c0e0939b9bc9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:57.525188 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b7a6ef6e-c035-4014-ae1a-c0e0939b9bc9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:57.536383 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b7a6ef6e-c035-4014-ae1a-c0e0939b9bc9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:57.540662 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b7a6ef6e-c035-4014-ae1a-c0e0939b9bc9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:57.540662 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b7a6ef6e-c035-4014-ae1a-c0e0939b9bc9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:57.540662 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b7a6ef6e-c035-4014-ae1a-c0e0939b9bc9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:57.975722 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-4b43fa55-f4dd-497c-b8d7-46e170bb129c req-191feee8-e7fe-4361-820e-dacfbc33bc70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be48aa4e-115e-4d58-8940-f722120f4664", "tag": "8539e658-97e4-4b54-88b0-968fec4fe3fa"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:41:57.975722 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-4b43fa55-f4dd-497c-b8d7-46e170bb129c req-191feee8-e7fe-4361-820e-dacfbc33bc70 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:57.975722 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-4b43fa55-f4dd-497c-b8d7-46e170bb129c req-191feee8-e7fe-4361-820e-dacfbc33bc70 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:57.975722 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-4b43fa55-f4dd-497c-b8d7-46e170bb129c req-191feee8-e7fe-4361-820e-dacfbc33bc70 service nova] Creating event network-changed:8539e658-97e4-4b54-88b0-968fec4fe3fa for instance be48aa4e-115e-4d58-8940-f722120f4664 on hv-cinder-83716 Jun 17 11:41:57.978889 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-4b43fa55-f4dd-497c-b8d7-46e170bb129c req-191feee8-e7fe-4361-820e-dacfbc33bc70 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049095 Jun 17 11:41:57.978889 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 67/128] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:41:57.980008 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b7a6ef6e-c035-4014-ae1a-c0e0939b9bc9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:57.980008 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b7a6ef6e-c035-4014-ae1a-c0e0939b9bc9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1521 microversion: 2.1 time: 0.402689 Jun 17 11:41:57.980008 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 62/129] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:57 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1521 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:41:58.081926 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-28a1c642-0e1e-43aa-a1c0-c03f1a7b3450 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:58.082179 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-28a1c642-0e1e-43aa-a1c0-c03f1a7b3450 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:58.093273 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-28a1c642-0e1e-43aa-a1c0-c03f1a7b3450 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:58.093704 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-28a1c642-0e1e-43aa-a1c0-c03f1a7b3450 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:58.097584 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-28a1c642-0e1e-43aa-a1c0-c03f1a7b3450 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:58.115917 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-28a1c642-0e1e-43aa-a1c0-c03f1a7b3450 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:58.486938 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-28a1c642-0e1e-43aa-a1c0-c03f1a7b3450 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:58.500601 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-28a1c642-0e1e-43aa-a1c0-c03f1a7b3450 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:58.501372 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-28a1c642-0e1e-43aa-a1c0-c03f1a7b3450 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:58.510597 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-28a1c642-0e1e-43aa-a1c0-c03f1a7b3450 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1598 microversion: 2.20 time: 0.427100 Jun 17 11:41:58.512157 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 68/130] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:41:58 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1598 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:41:58.525303 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-765fcd76-be6d-4b8d-8522-1afccb4bfece tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:58.526203 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-765fcd76-be6d-4b8d-8522-1afccb4bfece tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:58.542405 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-765fcd76-be6d-4b8d-8522-1afccb4bfece tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:58.542978 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-765fcd76-be6d-4b8d-8522-1afccb4bfece tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:58.543863 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-765fcd76-be6d-4b8d-8522-1afccb4bfece tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:58.544310 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-765fcd76-be6d-4b8d-8522-1afccb4bfece tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:58.607269 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:41:58.790014 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-765fcd76-be6d-4b8d-8522-1afccb4bfece tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.267572 Jun 17 11:41:58.791283 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 63/131] 10.222.0.45 () {60 vars in 1315 bytes} [Fri Jun 17 11:41:58 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972/os-interface => generated 284 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 11:41:58.940161 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5ef8215d-8b5c-42d5-8211-82dd39d5d004 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:41:58.940770 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-5ef8215d-8b5c-42d5-8211-82dd39d5d004 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:41:58.947228 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5ef8215d-8b5c-42d5-8211-82dd39d5d004 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:58.947710 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5ef8215d-8b5c-42d5-8211-82dd39d5d004 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:58.948478 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5ef8215d-8b5c-42d5-8211-82dd39d5d004 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:41:58.949103 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5ef8215d-8b5c-42d5-8211-82dd39d5d004 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:41:59.547247 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5ef8215d-8b5c-42d5-8211-82dd39d5d004 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:41:59.568311 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5ef8215d-8b5c-42d5-8211-82dd39d5d004 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1521 microversion: 2.1 time: 0.631829 Jun 17 11:41:59.571752 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 69/132] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:41:58 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1521 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:00.591092 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-16bec6f6-a79f-4efe-81f5-784159768ed1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:00.592539 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-16bec6f6-a79f-4efe-81f5-784159768ed1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:00.633736 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-16bec6f6-a79f-4efe-81f5-784159768ed1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:00.634442 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-16bec6f6-a79f-4efe-81f5-784159768ed1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:00.635577 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-16bec6f6-a79f-4efe-81f5-784159768ed1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:00.635951 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-16bec6f6-a79f-4efe-81f5-784159768ed1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:00.796463 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-27f8fc34-dbe6-4211-bc61-86e8c5bf2794 req-ac3bacf1-4e5c-44f2-ac1d-967cad805df5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71050501-8f84-4701-a013-bfc7a4459972", "tag": "4f9d2fad-e808-44df-adda-539bddcec93d"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:42:00.809992 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-27f8fc34-dbe6-4211-bc61-86e8c5bf2794 req-ac3bacf1-4e5c-44f2-ac1d-967cad805df5 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:00.810462 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-27f8fc34-dbe6-4211-bc61-86e8c5bf2794 req-ac3bacf1-4e5c-44f2-ac1d-967cad805df5 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:00.829338 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-27f8fc34-dbe6-4211-bc61-86e8c5bf2794 req-ac3bacf1-4e5c-44f2-ac1d-967cad805df5 service nova] Creating event network-changed:4f9d2fad-e808-44df-adda-539bddcec93d for instance 71050501-8f84-4701-a013-bfc7a4459972 on hv-cinder-83716 Jun 17 11:42:00.837702 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-27f8fc34-dbe6-4211-bc61-86e8c5bf2794 req-ac3bacf1-4e5c-44f2-ac1d-967cad805df5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045328 Jun 17 11:42:00.838546 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 70/133] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:42:00.951930 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-16bec6f6-a79f-4efe-81f5-784159768ed1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:00.964081 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-16bec6f6-a79f-4efe-81f5-784159768ed1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1521 microversion: 2.1 time: 0.380322 Jun 17 11:42:00.964770 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 64/134] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:00 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1521 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:01.983187 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-7b158c14-551c-4bd0-b70c-f2dd7ea970e0 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:01.984482 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7b158c14-551c-4bd0-b70c-f2dd7ea970e0 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:01.991434 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7b158c14-551c-4bd0-b70c-f2dd7ea970e0 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:01.992246 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7b158c14-551c-4bd0-b70c-f2dd7ea970e0 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:01.993260 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7b158c14-551c-4bd0-b70c-f2dd7ea970e0 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:01.993841 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7b158c14-551c-4bd0-b70c-f2dd7ea970e0 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:02.172281 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7b158c14-551c-4bd0-b70c-f2dd7ea970e0 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:02.182539 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-7b158c14-551c-4bd0-b70c-f2dd7ea970e0 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1521 microversion: 2.1 time: 0.205046 Jun 17 11:42:02.183237 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 71/135] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:01 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:03.204644 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-7e5512d8-3247-49d2-a8d9-060e1745b0b5 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:03.204644 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-7e5512d8-3247-49d2-a8d9-060e1745b0b5 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:03.209507 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7e5512d8-3247-49d2-a8d9-060e1745b0b5 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:03.209625 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7e5512d8-3247-49d2-a8d9-060e1745b0b5 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:03.210312 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7e5512d8-3247-49d2-a8d9-060e1745b0b5 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:03.210767 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7e5512d8-3247-49d2-a8d9-060e1745b0b5 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:03.366979 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-7e5512d8-3247-49d2-a8d9-060e1745b0b5 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:03.375006 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-7e5512d8-3247-49d2-a8d9-060e1745b0b5 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1521 microversion: 2.1 time: 0.178504 Jun 17 11:42:03.375619 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 65/136] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:03 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:04.394798 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f3e76abd-e5ee-42aa-9dbc-e3a082f241de tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:04.394798 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f3e76abd-e5ee-42aa-9dbc-e3a082f241de tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:04.405177 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f3e76abd-e5ee-42aa-9dbc-e3a082f241de tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:04.405177 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f3e76abd-e5ee-42aa-9dbc-e3a082f241de tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:04.405177 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f3e76abd-e5ee-42aa-9dbc-e3a082f241de tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:04.405177 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f3e76abd-e5ee-42aa-9dbc-e3a082f241de tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:04.543217 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f3e76abd-e5ee-42aa-9dbc-e3a082f241de tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:04.548192 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f3e76abd-e5ee-42aa-9dbc-e3a082f241de tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1521 microversion: 2.1 time: 0.158333 Jun 17 11:42:04.548760 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 72/137] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:04 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:42:05.303303 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-5b908640-dcc9-4ac3-9145-15912748470a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1085324075", "imageRef": "272eb2b7-ddf0-433f-8be8-cdc13c01be77", "flavorRef": "452", "networks": [{"uuid": "c6f48b6e-5e75-4a43-91dd-a0b6f2a37841"}]}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:42:05.368891 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.network.neutron [None req-5b908640-dcc9-4ac3-9145-15912748470a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] validate_networks() for [('c6f48b6e-5e75-4a43-91dd-a0b6f2a37841', None, None, None, None, None)] {{(pid=124845) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 11:42:05.566355 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-37d91590-a877-4991-89ac-a4e7e0f8607a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:05.567087 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-37d91590-a877-4991-89ac-a4e7e0f8607a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:05.574163 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-37d91590-a877-4991-89ac-a4e7e0f8607a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:05.574694 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-37d91590-a877-4991-89ac-a4e7e0f8607a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:05.575503 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-37d91590-a877-4991-89ac-a4e7e0f8607a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:05.575974 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-37d91590-a877-4991-89ac-a4e7e0f8607a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:05.809994 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-37d91590-a877-4991-89ac-a4e7e0f8607a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:05.818134 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-37d91590-a877-4991-89ac-a4e7e0f8607a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1521 microversion: 2.1 time: 0.255557 Jun 17 11:42:05.818832 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 73/138] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:05 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:42:05.840628 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-5b908640-dcc9-4ac3-9145-15912748470a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Flavor limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 11:42:05.841386 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-5b908640-dcc9-4ac3-9145-15912748470a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Image limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 11:42:05.842043 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-5b908640-dcc9-4ac3-9145-15912748470a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Flavor pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 11:42:05.842445 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-5b908640-dcc9-4ac3-9145-15912748470a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Image pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 11:42:05.842801 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-5b908640-dcc9-4ac3-9145-15912748470a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 11:42:05.852662 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5b908640-dcc9-4ac3-9145-15912748470a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:05.853102 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5b908640-dcc9-4ac3-9145-15912748470a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:05.854104 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5b908640-dcc9-4ac3-9145-15912748470a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:05.854536 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5b908640-dcc9-4ac3-9145-15912748470a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:05.874463 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-5b908640-dcc9-4ac3-9145-15912748470a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Getting quotas for project b1c1e0064ef5486795031aff48250978. Resources: {'instances', 'ram', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 11:42:05.879023 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-5b908640-dcc9-4ac3-9145-15912748470a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Getting quotas for user ee6039f599d44024ac3fdd6cbb65e62f and project b1c1e0064ef5486795031aff48250978. Resources: {'instances', 'ram', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 11:42:05.893298 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-5b908640-dcc9-4ac3-9145-15912748470a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Going to run 1 instances... {{(pid=124845) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 11:42:05.901528 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-5b908640-dcc9-4ac3-9145-15912748470a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: b237f1d1-5f28-467b-aca8-a2e1d61ec8fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='272eb2b7-ddf0-433f-8be8-cdc13c01be77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 11:42:06.319709 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-41f79418-562e-4109-b6a2-a77b3644681e tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:06.320270 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-41f79418-562e-4109-b6a2-a77b3644681e tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] [instance: 8decdd22-7413-438f-94d0-5c3238a2072b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:06.326529 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-41f79418-562e-4109-b6a2-a77b3644681e tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:06.326974 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-41f79418-562e-4109-b6a2-a77b3644681e tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:06.327771 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-41f79418-562e-4109-b6a2-a77b3644681e tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:06.328240 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-41f79418-562e-4109-b6a2-a77b3644681e tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:06.355121 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-41f79418-562e-4109-b6a2-a77b3644681e tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] [instance: 8decdd22-7413-438f-94d0-5c3238a2072b] Going to try to terminate instance {{(pid=124844) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 11:42:06.533801 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-5b908640-dcc9-4ac3-9145-15912748470a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.234337 Jun 17 11:42:06.534687 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 66/139] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 17 11:42:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 11:42:06.546479 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-20bb4c5a-9b79-4bcf-a9fa-3401f469554e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:06.547136 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-20bb4c5a-9b79-4bcf-a9fa-3401f469554e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: b237f1d1-5f28-467b-aca8-a2e1d61ec8fa] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:06.601921 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-20bb4c5a-9b79-4bcf-a9fa-3401f469554e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:06.610941 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-20bb4c5a-9b79-4bcf-a9fa-3401f469554e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa" status: 200 len: 1214 microversion: 2.1 time: 0.068569 Jun 17 11:42:06.612042 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 67/140] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:06 2022] GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:42:06.755358 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=100 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:42:06.836058 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-00577ac6-dfa1-43a6-8e68-7c1deeebe7ae tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:06.837242 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-00577ac6-dfa1-43a6-8e68-7c1deeebe7ae tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:06.844342 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-00577ac6-dfa1-43a6-8e68-7c1deeebe7ae tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:06.844830 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-00577ac6-dfa1-43a6-8e68-7c1deeebe7ae tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:06.845608 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-00577ac6-dfa1-43a6-8e68-7c1deeebe7ae tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:06.846045 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-00577ac6-dfa1-43a6-8e68-7c1deeebe7ae tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:06.855825 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-41f79418-562e-4109-b6a2-a77b3644681e tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b" status: 204 len: 0 microversion: 2.1 time: 0.539722 Jun 17 11:42:06.856685 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 74/141] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 17 11:42:06 2022] DELETE /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b => generated 0 bytes in 542 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 17 11:42:06.865168 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-0542d6dc-eff1-4491-ad5e-46bed0aca7f6 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:06.866084 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-0542d6dc-eff1-4491-ad5e-46bed0aca7f6 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] [instance: 8decdd22-7413-438f-94d0-5c3238a2072b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:06.875678 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0542d6dc-eff1-4491-ad5e-46bed0aca7f6 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:06.876324 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0542d6dc-eff1-4491-ad5e-46bed0aca7f6 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:06.877167 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0542d6dc-eff1-4491-ad5e-46bed0aca7f6 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:06.877696 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0542d6dc-eff1-4491-ad5e-46bed0aca7f6 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:07.066028 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-00577ac6-dfa1-43a6-8e68-7c1deeebe7ae tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:07.076030 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-00577ac6-dfa1-43a6-8e68-7c1deeebe7ae tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1521 microversion: 2.1 time: 0.243809 Jun 17 11:42:07.077620 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 68/142] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:06 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:42:07.097067 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-0542d6dc-eff1-4491-ad5e-46bed0aca7f6 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d78520e9c2483c94050fc91d9e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebd69a2ffc492eae05aaf62e2d8ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:07.106518 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-0542d6dc-eff1-4491-ad5e-46bed0aca7f6 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] 10.222.0.45 "GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b" status: 200 len: 1555 microversion: 2.1 time: 0.245150 Jun 17 11:42:07.107096 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 75/143] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:06 2022] GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b => generated 1555 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:42:07.629178 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-fa7e3df6-e988-49ce-89e0-6a7e97c20187 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:07.629918 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-fa7e3df6-e988-49ce-89e0-6a7e97c20187 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: b237f1d1-5f28-467b-aca8-a2e1d61ec8fa] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:07.695247 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-fa7e3df6-e988-49ce-89e0-6a7e97c20187 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:07.697067 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-fa7e3df6-e988-49ce-89e0-6a7e97c20187 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa" status: 200 len: 1214 microversion: 2.1 time: 0.072092 Jun 17 11:42:07.697845 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 69/144] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:07 2022] GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:08.093886 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-febcccc9-6ffa-4abd-9d96-850e8658e376 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:08.094553 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-febcccc9-6ffa-4abd-9d96-850e8658e376 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:08.100796 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-febcccc9-6ffa-4abd-9d96-850e8658e376 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:08.101244 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-febcccc9-6ffa-4abd-9d96-850e8658e376 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:08.102017 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-febcccc9-6ffa-4abd-9d96-850e8658e376 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:08.103071 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-febcccc9-6ffa-4abd-9d96-850e8658e376 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:08.124432 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-215a5640-df04-4e22-89a1-68ceef784c90 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:08.125354 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-215a5640-df04-4e22-89a1-68ceef784c90 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] [instance: 8decdd22-7413-438f-94d0-5c3238a2072b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:08.131980 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-215a5640-df04-4e22-89a1-68ceef784c90 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:08.132551 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-215a5640-df04-4e22-89a1-68ceef784c90 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:08.133554 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-215a5640-df04-4e22-89a1-68ceef784c90 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:08.134104 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-215a5640-df04-4e22-89a1-68ceef784c90 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:08.329325 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-febcccc9-6ffa-4abd-9d96-850e8658e376 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:08.337936 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-215a5640-df04-4e22-89a1-68ceef784c90 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d78520e9c2483c94050fc91d9e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebd69a2ffc492eae05aaf62e2d8ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:08.346966 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-215a5640-df04-4e22-89a1-68ceef784c90 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] 10.222.0.45 "GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b" status: 200 len: 1555 microversion: 2.1 time: 0.226740 Jun 17 11:42:08.347729 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-febcccc9-6ffa-4abd-9d96-850e8658e376 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1521 microversion: 2.1 time: 0.257804 Jun 17 11:42:08.348700 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 76/145] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:08 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:08.357844 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 70/146] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:08 2022] GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b => generated 1555 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:42:08.714442 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a6e09f08-7c83-459c-842b-1fa8b455b40d tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:08.715051 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a6e09f08-7c83-459c-842b-1fa8b455b40d tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: b237f1d1-5f28-467b-aca8-a2e1d61ec8fa] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:08.721167 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a6e09f08-7c83-459c-842b-1fa8b455b40d tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:08.721532 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a6e09f08-7c83-459c-842b-1fa8b455b40d tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:08.722319 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a6e09f08-7c83-459c-842b-1fa8b455b40d tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:08.722760 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a6e09f08-7c83-459c-842b-1fa8b455b40d tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:08.795047 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a6e09f08-7c83-459c-842b-1fa8b455b40d tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:08.806627 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a6e09f08-7c83-459c-842b-1fa8b455b40d tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa" status: 200 len: 1218 microversion: 2.1 time: 0.095463 Jun 17 11:42:08.807479 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 77/147] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:08 2022] GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:09.365832 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-899532c4-e167-4941-a615-b2b36906278f tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:09.367268 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-899532c4-e167-4941-a615-b2b36906278f tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] [instance: 8decdd22-7413-438f-94d0-5c3238a2072b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:09.372617 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-174ffbf0-c269-43f4-8a43-49db79d14d89 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:09.373516 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-174ffbf0-c269-43f4-8a43-49db79d14d89 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:09.376540 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-899532c4-e167-4941-a615-b2b36906278f tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:09.377127 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-899532c4-e167-4941-a615-b2b36906278f tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:09.378006 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-899532c4-e167-4941-a615-b2b36906278f tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:09.378529 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-899532c4-e167-4941-a615-b2b36906278f tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:09.382670 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-174ffbf0-c269-43f4-8a43-49db79d14d89 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:09.382670 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-174ffbf0-c269-43f4-8a43-49db79d14d89 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:09.382670 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-174ffbf0-c269-43f4-8a43-49db79d14d89 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:09.382670 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-174ffbf0-c269-43f4-8a43-49db79d14d89 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:09.712744 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-899532c4-e167-4941-a615-b2b36906278f tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d78520e9c2483c94050fc91d9e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebd69a2ffc492eae05aaf62e2d8ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:09.722217 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-899532c4-e167-4941-a615-b2b36906278f tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] 10.222.0.45 "GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b" status: 200 len: 1555 microversion: 2.1 time: 0.360777 Jun 17 11:42:09.722890 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 71/148] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:09 2022] GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b => generated 1555 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:09.726406 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-174ffbf0-c269-43f4-8a43-49db79d14d89 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:09.736600 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-174ffbf0-c269-43f4-8a43-49db79d14d89 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1521 microversion: 2.1 time: 0.370488 Jun 17 11:42:09.737815 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 78/149] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:09 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1521 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:42:09.826211 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-5f6b7a6c-8ed0-470b-b307-fef03279fb70 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:09.826905 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-5f6b7a6c-8ed0-470b-b307-fef03279fb70 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: b237f1d1-5f28-467b-aca8-a2e1d61ec8fa] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:09.833309 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5f6b7a6c-8ed0-470b-b307-fef03279fb70 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:09.833764 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5f6b7a6c-8ed0-470b-b307-fef03279fb70 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:09.834528 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5f6b7a6c-8ed0-470b-b307-fef03279fb70 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:09.835117 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5f6b7a6c-8ed0-470b-b307-fef03279fb70 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:09.935326 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5f6b7a6c-8ed0-470b-b307-fef03279fb70 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:09.949465 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-5f6b7a6c-8ed0-470b-b307-fef03279fb70 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa" status: 200 len: 1266 microversion: 2.1 time: 0.128398 Jun 17 11:42:09.950069 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 72/150] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:09 2022] GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa => generated 1266 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:10.199648 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-4a97c074-f1f5-48b5-895f-f673eaac0332 req-3c3a6d3d-8f23-4211-8d6e-167daede6cec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8decdd22-7413-438f-94d0-5c3238a2072b", "name": "network-vif-deleted", "tag": "199985a1-d517-4233-be02-8ddb17816c27"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:42:10.209700 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-4a97c074-f1f5-48b5-895f-f673eaac0332 req-3c3a6d3d-8f23-4211-8d6e-167daede6cec service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:10.210582 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-4a97c074-f1f5-48b5-895f-f673eaac0332 req-3c3a6d3d-8f23-4211-8d6e-167daede6cec service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:10.229367 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-4a97c074-f1f5-48b5-895f-f673eaac0332 req-3c3a6d3d-8f23-4211-8d6e-167daede6cec service nova] Creating event network-vif-deleted:199985a1-d517-4233-be02-8ddb17816c27 for instance 8decdd22-7413-438f-94d0-5c3238a2072b on hv-cinder-83716 Jun 17 11:42:10.237402 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-4a97c074-f1f5-48b5-895f-f673eaac0332 req-3c3a6d3d-8f23-4211-8d6e-167daede6cec service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042358 Jun 17 11:42:10.238157 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 79/151] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:42:10.743681 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-cf10144d-f776-47da-9298-645497ad6e6a tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:10.745226 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-cf10144d-f776-47da-9298-645497ad6e6a tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] [instance: 8decdd22-7413-438f-94d0-5c3238a2072b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:10.757841 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-88457b7e-7cb1-44a7-9d39-3ce9d47d7e3e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:10.758621 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-88457b7e-7cb1-44a7-9d39-3ce9d47d7e3e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:10.764712 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cf10144d-f776-47da-9298-645497ad6e6a tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:10.766396 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cf10144d-f776-47da-9298-645497ad6e6a tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:10.766396 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cf10144d-f776-47da-9298-645497ad6e6a tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:10.766894 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cf10144d-f776-47da-9298-645497ad6e6a tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:10.778403 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-88457b7e-7cb1-44a7-9d39-3ce9d47d7e3e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:10.778857 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-88457b7e-7cb1-44a7-9d39-3ce9d47d7e3e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:10.779697 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-88457b7e-7cb1-44a7-9d39-3ce9d47d7e3e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:10.781496 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-88457b7e-7cb1-44a7-9d39-3ce9d47d7e3e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:11.022325 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-cf10144d-f776-47da-9298-645497ad6e6a tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d78520e9c2483c94050fc91d9e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebd69a2ffc492eae05aaf62e2d8ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:11.031600 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-cf10144d-f776-47da-9298-645497ad6e6a tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] 10.222.0.45 "GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b" status: 200 len: 1346 microversion: 2.1 time: 0.293321 Jun 17 11:42:11.032199 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 73/152] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:10 2022] GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b => generated 1346 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:11.041309 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-db254556-bdd5-4f3a-9619-00adc1322c7c tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:11.042347 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-db254556-bdd5-4f3a-9619-00adc1322c7c tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: b237f1d1-5f28-467b-aca8-a2e1d61ec8fa] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:11.049069 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-db254556-bdd5-4f3a-9619-00adc1322c7c tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:11.049697 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-db254556-bdd5-4f3a-9619-00adc1322c7c tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:11.050479 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-db254556-bdd5-4f3a-9619-00adc1322c7c tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:11.050913 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-db254556-bdd5-4f3a-9619-00adc1322c7c tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:11.146954 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-db254556-bdd5-4f3a-9619-00adc1322c7c tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:11.155353 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-db254556-bdd5-4f3a-9619-00adc1322c7c tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa" status: 200 len: 1272 microversion: 2.1 time: 0.122100 Jun 17 11:42:11.156429 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 74/153] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:11 2022] GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa => generated 1272 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:11.172723 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-88457b7e-7cb1-44a7-9d39-3ce9d47d7e3e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:11.180953 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-88457b7e-7cb1-44a7-9d39-3ce9d47d7e3e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1521 microversion: 2.1 time: 0.427595 Jun 17 11:42:11.181641 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 80/154] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:10 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1521 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:12.050377 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-fae413af-7b6d-45c9-b016-92d8011f7bd7 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:12.050924 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-fae413af-7b6d-45c9-b016-92d8011f7bd7 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] [instance: 8decdd22-7413-438f-94d0-5c3238a2072b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:12.059387 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fae413af-7b6d-45c9-b016-92d8011f7bd7 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:12.060190 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fae413af-7b6d-45c9-b016-92d8011f7bd7 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:12.061428 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fae413af-7b6d-45c9-b016-92d8011f7bd7 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:12.061933 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fae413af-7b6d-45c9-b016-92d8011f7bd7 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:12.077841 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-fae413af-7b6d-45c9-b016-92d8011f7bd7 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] HTTP exception thrown: Instance 8decdd22-7413-438f-94d0-5c3238a2072b could not be found. Jun 17 11:42:12.083051 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-fae413af-7b6d-45c9-b016-92d8011f7bd7 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Request method failure captured: Jun 17 11:42:12.083051 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b HTTP/1.1 Jun 17 11:42:12.083051 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jun 17 11:42:12.083051 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jun 17 11:42:12.083051 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Connection: close Jun 17 11:42:12.083051 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jun 17 11:42:12.083051 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jun 17 11:42:12.083051 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.45 Jun 17 11:42:12.083051 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jun 17 11:42:12.083051 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jun 17 11:42:12.083051 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABirGhRfeIDYyTw9fG4Neb2_Zgc_9XKksJiV3-akrWq_fQ1WXMP4-Ad3ReFOrCTrFn1psQdAkgpwdUnjpDqMTNB0sWEsPpPvfMBfy-nNoxeHKc7q32K3nz_5VuyBTLxmnSZWP-EhITAZ7fyWlOcYttOj5utNllh-VW1Nbs9s6mTd0dl0yg Jun 17 11:42:12.083051 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jun 17 11:42:12.083051 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jun 17 11:42:12.083051 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jun 17 11:42:12.083051 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jun 17 11:42:12.083051 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jun 17 11:42:12.083051 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jun 17 11:42:12.083051 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Id: b9ebd69a2ffc492eae05aaf62e2d8ee2 Jun 17 11:42:12.083051 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-DeleteServersTestJSON-2060216478 Jun 17 11:42:12.083051 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jun 17 11:42:12.083051 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jun 17 11:42:12.084619 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b9ebd69a2ffc492eae05aaf62e2d8ee2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b9ebd69a2ffc492eae05aaf62e2d8ee2", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b9ebd69a2ffc492eae05aaf62e2d8ee2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b9ebd69a2ffc492eae05aaf62e2d8ee2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:42:12.084619 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-DeleteServersTestJSON-2060216478 Jun 17 11:42:12.084619 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: b9ebd69a2ffc492eae05aaf62e2d8ee2 Jun 17 11:42:12.084619 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-DeleteServersTestJSON-2060216478 Jun 17 11:42:12.084619 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User: tempest-DeleteServersTestJSON-2060216478-project Jun 17 11:42:12.084619 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jun 17 11:42:12.084619 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jun 17 11:42:12.084619 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Id: 14d78520e9c2483c94050fc91d9e4eca Jun 17 11:42:12.084619 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-DeleteServersTestJSON-2060216478-project Jun 17 11:42:12.084619 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: method: > Jun 17 11:42:12.084619 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: exception: Instance 8decdd22-7413-438f-94d0-5c3238a2072b could not be found. Jun 17 11:42:12.084619 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: action_args: {'id': '8decdd22-7413-438f-94d0-5c3238a2072b'} Jun 17 11:42:12.085450 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:42:12.085450 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:42:12.085450 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:42:12.085450 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:42:12.085450 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:42:12.085450 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:42:12.085450 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:42:12.085450 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:42:12.085450 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:42:12.085450 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:42:12.085450 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8decdd22-7413-438f-94d0-5c3238a2072b could not be found. Jun 17 11:42:12.085450 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:42:12.085450 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:42:12.085450 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:42:12.085450 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:42:12.085450 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:42:12.085450 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:42:12.085450 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:42:12.085450 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:42:12.085450 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:42:12.086785 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:42:12.086785 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 11:42:12.086785 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 11:42:12.086785 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:42:12.086785 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:42:12.086785 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:42:12.086785 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:42:12.086785 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8decdd22-7413-438f-94d0-5c3238a2072b could not be found. Jun 17 11:42:12.086785 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:42:12.086785 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:42:12.086785 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:42:12.086785 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:42:12.086785 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:42:12.086785 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:42:12.086785 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:42:12.086785 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:42:12.086785 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8decdd22-7413-438f-94d0-5c3238a2072b could not be found. Jun 17 11:42:12.086785 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:42:12.089667 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-fae413af-7b6d-45c9-b016-92d8011f7bd7 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Returning 404 to user: Instance 8decdd22-7413-438f-94d0-5c3238a2072b could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:42:12.090684 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-fae413af-7b6d-45c9-b016-92d8011f7bd7 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] 10.222.0.45 "GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b" status: 404 len: 111 microversion: 2.1 time: 0.044844 Jun 17 11:42:12.091258 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 75/155] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:12 2022] GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:42:12.172944 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-fac0c904-5476-423e-b729-f47ecf9d2b28 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:12.173682 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-fac0c904-5476-423e-b729-f47ecf9d2b28 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: b237f1d1-5f28-467b-aca8-a2e1d61ec8fa] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:12.179752 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fac0c904-5476-423e-b729-f47ecf9d2b28 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:12.184667 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fac0c904-5476-423e-b729-f47ecf9d2b28 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:12.184667 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fac0c904-5476-423e-b729-f47ecf9d2b28 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:12.184667 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fac0c904-5476-423e-b729-f47ecf9d2b28 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:12.204626 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f2633462-515a-4dfd-83d0-4a23e4f9bc52 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:12.205793 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f2633462-515a-4dfd-83d0-4a23e4f9bc52 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:12.215317 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f2633462-515a-4dfd-83d0-4a23e4f9bc52 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:12.216083 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f2633462-515a-4dfd-83d0-4a23e4f9bc52 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:12.217006 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f2633462-515a-4dfd-83d0-4a23e4f9bc52 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:12.217584 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f2633462-515a-4dfd-83d0-4a23e4f9bc52 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:12.457518 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-fac0c904-5476-423e-b729-f47ecf9d2b28 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:12.462372 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:42:12.472630 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-fac0c904-5476-423e-b729-f47ecf9d2b28 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa" status: 200 len: 1314 microversion: 2.1 time: 0.303504 Jun 17 11:42:12.474131 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 81/156] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:12 2022] GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:12.484346 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b6e42cb7-7d63-4550-9c74-622165c34464 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:12.485440 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b6e42cb7-7d63-4550-9c74-622165c34464 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] [instance: 8decdd22-7413-438f-94d0-5c3238a2072b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:12.492869 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b6e42cb7-7d63-4550-9c74-622165c34464 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:12.495770 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b6e42cb7-7d63-4550-9c74-622165c34464 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:12.495770 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b6e42cb7-7d63-4550-9c74-622165c34464 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:12.495770 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b6e42cb7-7d63-4550-9c74-622165c34464 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:12.512849 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-b6e42cb7-7d63-4550-9c74-622165c34464 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] HTTP exception thrown: Instance 8decdd22-7413-438f-94d0-5c3238a2072b could not be found. Jun 17 11:42:12.516353 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f2633462-515a-4dfd-83d0-4a23e4f9bc52 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:12.523755 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b6e42cb7-7d63-4550-9c74-622165c34464 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Request method failure captured: Jun 17 11:42:12.523755 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: request: GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b/os-volume_attachments HTTP/1.1 Jun 17 11:42:12.523755 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept: application/json Jun 17 11:42:12.523755 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jun 17 11:42:12.523755 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Connection: close Jun 17 11:42:12.523755 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jun 17 11:42:12.523755 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jun 17 11:42:12.523755 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Host: 10.222.0.45 Jun 17 11:42:12.523755 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jun 17 11:42:12.523755 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jun 17 11:42:12.523755 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABirGhRfeIDYyTw9fG4Neb2_Zgc_9XKksJiV3-akrWq_fQ1WXMP4-Ad3ReFOrCTrFn1psQdAkgpwdUnjpDqMTNB0sWEsPpPvfMBfy-nNoxeHKc7q32K3nz_5VuyBTLxmnSZWP-EhITAZ7fyWlOcYttOj5utNllh-VW1Nbs9s6mTd0dl0yg Jun 17 11:42:12.523755 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jun 17 11:42:12.523755 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jun 17 11:42:12.523755 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jun 17 11:42:12.523755 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jun 17 11:42:12.523755 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jun 17 11:42:12.523755 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jun 17 11:42:12.523755 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Id: b9ebd69a2ffc492eae05aaf62e2d8ee2 Jun 17 11:42:12.523755 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-DeleteServersTestJSON-2060216478 Jun 17 11:42:12.523755 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Role: member,reader Jun 17 11:42:12.523755 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Roles: member,reader Jun 17 11:42:12.526264 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b9ebd69a2ffc492eae05aaf62e2d8ee2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b9ebd69a2ffc492eae05aaf62e2d8ee2", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b9ebd69a2ffc492eae05aaf62e2d8ee2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b9ebd69a2ffc492eae05aaf62e2d8ee2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:42:12.526264 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-DeleteServersTestJSON-2060216478 Jun 17 11:42:12.526264 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Id: b9ebd69a2ffc492eae05aaf62e2d8ee2 Jun 17 11:42:12.526264 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-DeleteServersTestJSON-2060216478 Jun 17 11:42:12.526264 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User: tempest-DeleteServersTestJSON-2060216478-project Jun 17 11:42:12.526264 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jun 17 11:42:12.526264 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jun 17 11:42:12.526264 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Id: 14d78520e9c2483c94050fc91d9e4eca Jun 17 11:42:12.526264 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-DeleteServersTestJSON-2060216478-project Jun 17 11:42:12.526264 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: method: > Jun 17 11:42:12.526264 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: exception: Instance 8decdd22-7413-438f-94d0-5c3238a2072b could not be found. Jun 17 11:42:12.526264 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: action_args: {'server_id': '8decdd22-7413-438f-94d0-5c3238a2072b'} Jun 17 11:42:12.526913 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:42:12.526913 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:42:12.526913 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:42:12.526913 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:42:12.526913 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:42:12.526913 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:42:12.526913 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:42:12.526913 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:42:12.526913 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:42:12.526913 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:42:12.526913 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8decdd22-7413-438f-94d0-5c3238a2072b could not be found. Jun 17 11:42:12.526913 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:42:12.526913 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:42:12.526913 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:42:12.526913 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:42:12.526913 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:42:12.526913 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:42:12.526913 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:42:12.526913 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:42:12.526913 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:42:12.528282 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:42:12.528282 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 17 11:42:12.528282 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 11:42:12.528282 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 17 11:42:12.528282 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 11:42:12.528282 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 17 11:42:12.528282 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 17 11:42:12.528282 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:42:12.528282 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:42:12.528282 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8decdd22-7413-438f-94d0-5c3238a2072b could not be found. Jun 17 11:42:12.528282 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:42:12.528282 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:42:12.528282 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:42:12.528282 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:42:12.528282 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:42:12.528282 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:42:12.528282 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:42:12.528282 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:42:12.528282 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8decdd22-7413-438f-94d0-5c3238a2072b could not be found. Jun 17 11:42:12.528282 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:42:12.529463 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b6e42cb7-7d63-4550-9c74-622165c34464 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Returning 404 to user: Instance 8decdd22-7413-438f-94d0-5c3238a2072b could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:42:12.529533 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f2633462-515a-4dfd-83d0-4a23e4f9bc52 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1521 microversion: 2.1 time: 0.326245 Jun 17 11:42:12.529533 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 76/157] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:12 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:12.529657 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b6e42cb7-7d63-4550-9c74-622165c34464 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] 10.222.0.45 "GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.051903 Jun 17 11:42:12.529657 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 82/158] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 17 11:42:12 2022] GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b/os-volume_attachments => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:42:12.533742 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-8cb9ce16-7a9f-49bc-a804-cd05d9546647 req-2940174c-4927-4958-bfe6-b52f97f618b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b237f1d1-5f28-467b-aca8-a2e1d61ec8fa", "tag": "f24c26db-fd50-4c00-9701-98f77873ea46"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:42:12.546125 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-8cb9ce16-7a9f-49bc-a804-cd05d9546647 req-2940174c-4927-4958-bfe6-b52f97f618b6 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:12.547200 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-8cb9ce16-7a9f-49bc-a804-cd05d9546647 req-2940174c-4927-4958-bfe6-b52f97f618b6 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:12.560427 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-8cb9ce16-7a9f-49bc-a804-cd05d9546647 req-2940174c-4927-4958-bfe6-b52f97f618b6 service nova] Creating event network-changed:f24c26db-fd50-4c00-9701-98f77873ea46 for instance b237f1d1-5f28-467b-aca8-a2e1d61ec8fa on hv-cinder-83716 Jun 17 11:42:12.565831 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-8cb9ce16-7a9f-49bc-a804-cd05d9546647 req-2940174c-4927-4958-bfe6-b52f97f618b6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038811 Jun 17 11:42:12.566710 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 77/159] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:42:13.493936 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c0e05ebe-e35d-45e3-a319-1a9bf113c2b2 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:13.493936 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c0e05ebe-e35d-45e3-a319-1a9bf113c2b2 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: b237f1d1-5f28-467b-aca8-a2e1d61ec8fa] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:13.500714 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c0e05ebe-e35d-45e3-a319-1a9bf113c2b2 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:13.501160 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c0e05ebe-e35d-45e3-a319-1a9bf113c2b2 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:13.502559 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c0e05ebe-e35d-45e3-a319-1a9bf113c2b2 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:13.503181 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c0e05ebe-e35d-45e3-a319-1a9bf113c2b2 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:13.548979 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-fafcf8e6-744a-47e6-b264-7b72dfd7a6f5 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:13.550265 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-fafcf8e6-744a-47e6-b264-7b72dfd7a6f5 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:13.566822 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fafcf8e6-744a-47e6-b264-7b72dfd7a6f5 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:13.567882 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fafcf8e6-744a-47e6-b264-7b72dfd7a6f5 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:13.569398 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fafcf8e6-744a-47e6-b264-7b72dfd7a6f5 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:13.570325 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fafcf8e6-744a-47e6-b264-7b72dfd7a6f5 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:13.770304 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c0e05ebe-e35d-45e3-a319-1a9bf113c2b2 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:13.785070 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c0e05ebe-e35d-45e3-a319-1a9bf113c2b2 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa" status: 200 len: 1314 microversion: 2.1 time: 0.297483 Jun 17 11:42:13.785799 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 83/160] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:13 2022] GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:13.802358 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-fafcf8e6-744a-47e6-b264-7b72dfd7a6f5 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:13.810882 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-fafcf8e6-744a-47e6-b264-7b72dfd7a6f5 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1521 microversion: 2.1 time: 0.270369 Jun 17 11:42:13.811554 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 78/161] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:13 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:13.953880 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a9f5120b-cebe-4d29-8930-43268ac3b4a7 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:13.954403 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a9f5120b-cebe-4d29-8930-43268ac3b4a7 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] [instance: 8decdd22-7413-438f-94d0-5c3238a2072b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:13.961070 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a9f5120b-cebe-4d29-8930-43268ac3b4a7 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:13.961529 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a9f5120b-cebe-4d29-8930-43268ac3b4a7 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:13.962813 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a9f5120b-cebe-4d29-8930-43268ac3b4a7 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:13.963250 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a9f5120b-cebe-4d29-8930-43268ac3b4a7 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:13.977080 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-a9f5120b-cebe-4d29-8930-43268ac3b4a7 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] HTTP exception thrown: Instance 8decdd22-7413-438f-94d0-5c3238a2072b could not be found. Jun 17 11:42:13.979887 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a9f5120b-cebe-4d29-8930-43268ac3b4a7 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Request method failure captured: Jun 17 11:42:13.979887 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: request: DELETE /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b HTTP/1.1 Jun 17 11:42:13.979887 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept: application/json Jun 17 11:42:13.979887 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jun 17 11:42:13.979887 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Connection: close Jun 17 11:42:13.979887 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jun 17 11:42:13.979887 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jun 17 11:42:13.979887 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Host: 10.222.0.45 Jun 17 11:42:13.979887 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jun 17 11:42:13.979887 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jun 17 11:42:13.979887 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABirGhRfeIDYyTw9fG4Neb2_Zgc_9XKksJiV3-akrWq_fQ1WXMP4-Ad3ReFOrCTrFn1psQdAkgpwdUnjpDqMTNB0sWEsPpPvfMBfy-nNoxeHKc7q32K3nz_5VuyBTLxmnSZWP-EhITAZ7fyWlOcYttOj5utNllh-VW1Nbs9s6mTd0dl0yg Jun 17 11:42:13.979887 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jun 17 11:42:13.979887 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jun 17 11:42:13.979887 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jun 17 11:42:13.979887 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jun 17 11:42:13.979887 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jun 17 11:42:13.979887 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jun 17 11:42:13.979887 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Id: b9ebd69a2ffc492eae05aaf62e2d8ee2 Jun 17 11:42:13.979887 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-DeleteServersTestJSON-2060216478 Jun 17 11:42:13.979887 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Role: member,reader Jun 17 11:42:13.979887 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Roles: member,reader Jun 17 11:42:13.984839 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b9ebd69a2ffc492eae05aaf62e2d8ee2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b9ebd69a2ffc492eae05aaf62e2d8ee2", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b9ebd69a2ffc492eae05aaf62e2d8ee2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b9ebd69a2ffc492eae05aaf62e2d8ee2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:42:13.984839 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-DeleteServersTestJSON-2060216478 Jun 17 11:42:13.984839 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Id: b9ebd69a2ffc492eae05aaf62e2d8ee2 Jun 17 11:42:13.984839 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-DeleteServersTestJSON-2060216478 Jun 17 11:42:13.984839 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User: tempest-DeleteServersTestJSON-2060216478-project Jun 17 11:42:13.984839 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jun 17 11:42:13.984839 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jun 17 11:42:13.984839 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Id: 14d78520e9c2483c94050fc91d9e4eca Jun 17 11:42:13.984839 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-DeleteServersTestJSON-2060216478-project Jun 17 11:42:13.984839 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: method: > Jun 17 11:42:13.984839 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: exception: Instance 8decdd22-7413-438f-94d0-5c3238a2072b could not be found. Jun 17 11:42:13.984839 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: action_args: {'id': '8decdd22-7413-438f-94d0-5c3238a2072b'} Jun 17 11:42:13.985629 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:42:13.985629 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:42:13.985629 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:42:13.985629 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:42:13.985629 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:42:13.985629 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:42:13.985629 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:42:13.985629 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:42:13.985629 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:42:13.985629 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:42:13.985629 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8decdd22-7413-438f-94d0-5c3238a2072b could not be found. Jun 17 11:42:13.985629 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:42:13.985629 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:42:13.985629 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:42:13.985629 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:42:13.985629 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:42:13.985629 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:42:13.985629 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:42:13.985629 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:42:13.985629 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:42:13.986971 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:42:13.986971 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 11:42:13.986971 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 11:42:13.986971 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 11:42:13.986971 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 11:42:13.986971 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:42:13.986971 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:42:13.986971 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:42:13.986971 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:42:13.986971 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8decdd22-7413-438f-94d0-5c3238a2072b could not be found. Jun 17 11:42:13.986971 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:42:13.986971 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:42:13.986971 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:42:13.986971 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:42:13.986971 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:42:13.986971 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:42:13.986971 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:42:13.986971 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:42:13.986971 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8decdd22-7413-438f-94d0-5c3238a2072b could not be found. Jun 17 11:42:13.986971 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:42:13.988274 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a9f5120b-cebe-4d29-8930-43268ac3b4a7 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Returning 404 to user: Instance 8decdd22-7413-438f-94d0-5c3238a2072b could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:42:13.988274 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a9f5120b-cebe-4d29-8930-43268ac3b4a7 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b" status: 404 len: 111 microversion: 2.1 time: 0.031617 Jun 17 11:42:13.988274 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 84/162] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 17 11:42:13 2022] DELETE /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 11:42:13.990778 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-d12e446f-a750-49e6-8c0c-5fcc251d9de4 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:13.991402 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-d12e446f-a750-49e6-8c0c-5fcc251d9de4 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] [instance: 8decdd22-7413-438f-94d0-5c3238a2072b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:13.997784 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d12e446f-a750-49e6-8c0c-5fcc251d9de4 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:13.998235 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d12e446f-a750-49e6-8c0c-5fcc251d9de4 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:13.999000 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d12e446f-a750-49e6-8c0c-5fcc251d9de4 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:13.999523 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d12e446f-a750-49e6-8c0c-5fcc251d9de4 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:14.013666 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-d12e446f-a750-49e6-8c0c-5fcc251d9de4 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] HTTP exception thrown: Instance 8decdd22-7413-438f-94d0-5c3238a2072b could not be found. Jun 17 11:42:14.015316 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-d12e446f-a750-49e6-8c0c-5fcc251d9de4 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Request method failure captured: Jun 17 11:42:14.015316 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b HTTP/1.1 Jun 17 11:42:14.015316 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jun 17 11:42:14.015316 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jun 17 11:42:14.015316 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Connection: close Jun 17 11:42:14.015316 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jun 17 11:42:14.015316 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jun 17 11:42:14.015316 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.45 Jun 17 11:42:14.015316 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jun 17 11:42:14.015316 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jun 17 11:42:14.015316 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABirGhRfeIDYyTw9fG4Neb2_Zgc_9XKksJiV3-akrWq_fQ1WXMP4-Ad3ReFOrCTrFn1psQdAkgpwdUnjpDqMTNB0sWEsPpPvfMBfy-nNoxeHKc7q32K3nz_5VuyBTLxmnSZWP-EhITAZ7fyWlOcYttOj5utNllh-VW1Nbs9s6mTd0dl0yg Jun 17 11:42:14.015316 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jun 17 11:42:14.015316 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jun 17 11:42:14.015316 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jun 17 11:42:14.015316 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jun 17 11:42:14.015316 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jun 17 11:42:14.015316 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jun 17 11:42:14.015316 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Id: b9ebd69a2ffc492eae05aaf62e2d8ee2 Jun 17 11:42:14.015316 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-DeleteServersTestJSON-2060216478 Jun 17 11:42:14.015316 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jun 17 11:42:14.015316 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jun 17 11:42:14.016737 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b9ebd69a2ffc492eae05aaf62e2d8ee2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b9ebd69a2ffc492eae05aaf62e2d8ee2", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b9ebd69a2ffc492eae05aaf62e2d8ee2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b9ebd69a2ffc492eae05aaf62e2d8ee2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:42:14.016737 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-DeleteServersTestJSON-2060216478 Jun 17 11:42:14.016737 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: b9ebd69a2ffc492eae05aaf62e2d8ee2 Jun 17 11:42:14.016737 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-DeleteServersTestJSON-2060216478 Jun 17 11:42:14.016737 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User: tempest-DeleteServersTestJSON-2060216478-project Jun 17 11:42:14.016737 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jun 17 11:42:14.016737 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jun 17 11:42:14.016737 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Id: 14d78520e9c2483c94050fc91d9e4eca Jun 17 11:42:14.016737 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-DeleteServersTestJSON-2060216478-project Jun 17 11:42:14.016737 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: method: > Jun 17 11:42:14.016737 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: exception: Instance 8decdd22-7413-438f-94d0-5c3238a2072b could not be found. Jun 17 11:42:14.016737 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: action_args: {'id': '8decdd22-7413-438f-94d0-5c3238a2072b'} Jun 17 11:42:14.017587 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:42:14.017587 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:42:14.017587 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:42:14.017587 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:42:14.017587 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:42:14.017587 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:42:14.017587 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:42:14.017587 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:42:14.017587 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:42:14.017587 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:42:14.017587 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8decdd22-7413-438f-94d0-5c3238a2072b could not be found. Jun 17 11:42:14.017587 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:42:14.017587 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:42:14.017587 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:42:14.017587 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:42:14.017587 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:42:14.017587 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:42:14.017587 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:42:14.017587 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:42:14.017587 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:42:14.018706 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:42:14.018706 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 11:42:14.018706 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 11:42:14.018706 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:42:14.018706 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:42:14.018706 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:42:14.018706 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:42:14.018706 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8decdd22-7413-438f-94d0-5c3238a2072b could not be found. Jun 17 11:42:14.018706 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:42:14.018706 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:42:14.018706 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:42:14.018706 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:42:14.018706 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:42:14.018706 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:42:14.018706 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:42:14.018706 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:42:14.018706 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8decdd22-7413-438f-94d0-5c3238a2072b could not be found. Jun 17 11:42:14.018706 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:42:14.019755 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-d12e446f-a750-49e6-8c0c-5fcc251d9de4 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] Returning 404 to user: Instance 8decdd22-7413-438f-94d0-5c3238a2072b could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:42:14.019755 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-d12e446f-a750-49e6-8c0c-5fcc251d9de4 tempest-DeleteServersTestJSON-2060216478 tempest-DeleteServersTestJSON-2060216478-project] 10.222.0.45 "GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b" status: 404 len: 111 microversion: 2.1 time: 0.029924 Jun 17 11:42:14.019755 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 79/163] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:13 2022] GET /compute/v2.1/servers/8decdd22-7413-438f-94d0-5c3238a2072b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 11:42:14.803518 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-985c8be5-1192-48e4-a926-4566f43afae2 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:14.804227 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-985c8be5-1192-48e4-a926-4566f43afae2 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: b237f1d1-5f28-467b-aca8-a2e1d61ec8fa] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:14.812348 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-985c8be5-1192-48e4-a926-4566f43afae2 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:14.812914 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-985c8be5-1192-48e4-a926-4566f43afae2 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:14.813764 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-985c8be5-1192-48e4-a926-4566f43afae2 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:14.814292 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-985c8be5-1192-48e4-a926-4566f43afae2 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:14.828190 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ff34d53e-b708-4d59-9402-ef4b49f71c4f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:14.829666 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-ff34d53e-b708-4d59-9402-ef4b49f71c4f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:14.835996 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ff34d53e-b708-4d59-9402-ef4b49f71c4f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:14.836443 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ff34d53e-b708-4d59-9402-ef4b49f71c4f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:14.838021 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ff34d53e-b708-4d59-9402-ef4b49f71c4f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:14.838785 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ff34d53e-b708-4d59-9402-ef4b49f71c4f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:15.193468 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-985c8be5-1192-48e4-a926-4566f43afae2 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:15.201939 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-985c8be5-1192-48e4-a926-4566f43afae2 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa" status: 200 len: 1314 microversion: 2.1 time: 0.402277 Jun 17 11:42:15.211684 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 85/164] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:14 2022] GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:15.488976 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ff34d53e-b708-4d59-9402-ef4b49f71c4f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:15.498460 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-ff34d53e-b708-4d59-9402-ef4b49f71c4f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1521 microversion: 2.1 time: 0.673835 Jun 17 11:42:15.499061 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 80/165] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:14 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1521 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:16.222229 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-05c5a261-1b23-4e17-bfad-8a38f29a5ae5 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:16.223701 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-05c5a261-1b23-4e17-bfad-8a38f29a5ae5 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: b237f1d1-5f28-467b-aca8-a2e1d61ec8fa] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:16.234205 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-05c5a261-1b23-4e17-bfad-8a38f29a5ae5 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:16.234665 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-05c5a261-1b23-4e17-bfad-8a38f29a5ae5 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:16.235474 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-05c5a261-1b23-4e17-bfad-8a38f29a5ae5 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:16.236098 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-05c5a261-1b23-4e17-bfad-8a38f29a5ae5 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:16.483926 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-05c5a261-1b23-4e17-bfad-8a38f29a5ae5 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:16.494915 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-05c5a261-1b23-4e17-bfad-8a38f29a5ae5 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa" status: 200 len: 1314 microversion: 2.1 time: 0.278562 Jun 17 11:42:16.495684 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 86/166] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:16 2022] GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:16.515949 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-92d9e04c-ba5f-4b56-8520-2fb12c4f4006 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:16.516723 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-92d9e04c-ba5f-4b56-8520-2fb12c4f4006 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:16.522981 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:42:16.528085 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-92d9e04c-ba5f-4b56-8520-2fb12c4f4006 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:16.530657 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-92d9e04c-ba5f-4b56-8520-2fb12c4f4006 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:16.531924 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-92d9e04c-ba5f-4b56-8520-2fb12c4f4006 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:16.532747 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-92d9e04c-ba5f-4b56-8520-2fb12c4f4006 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:16.791100 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-92d9e04c-ba5f-4b56-8520-2fb12c4f4006 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:16.801484 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-92d9e04c-ba5f-4b56-8520-2fb12c4f4006 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1521 microversion: 2.1 time: 0.290335 Jun 17 11:42:16.803234 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 81/167] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:16 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:17.514400 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-06a8ed9d-3a81-42e8-9b6f-60f364a5cdc2 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:17.515697 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-06a8ed9d-3a81-42e8-9b6f-60f364a5cdc2 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: b237f1d1-5f28-467b-aca8-a2e1d61ec8fa] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:17.542229 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-06a8ed9d-3a81-42e8-9b6f-60f364a5cdc2 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:17.542836 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-06a8ed9d-3a81-42e8-9b6f-60f364a5cdc2 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:17.543856 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-06a8ed9d-3a81-42e8-9b6f-60f364a5cdc2 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:17.544291 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-06a8ed9d-3a81-42e8-9b6f-60f364a5cdc2 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:17.698909 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-06a8ed9d-3a81-42e8-9b6f-60f364a5cdc2 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:17.706820 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-06a8ed9d-3a81-42e8-9b6f-60f364a5cdc2 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa" status: 200 len: 1314 microversion: 2.1 time: 0.196304 Jun 17 11:42:17.707418 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 87/168] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:17 2022] GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:17.824557 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-d09df5cf-0247-4420-b532-95f2344b54ce tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:17.826161 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-d09df5cf-0247-4420-b532-95f2344b54ce tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:17.832451 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=10 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:42:17.835268 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d09df5cf-0247-4420-b532-95f2344b54ce tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:17.836037 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d09df5cf-0247-4420-b532-95f2344b54ce tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:17.839743 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d09df5cf-0247-4420-b532-95f2344b54ce tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:17.840369 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d09df5cf-0247-4420-b532-95f2344b54ce tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:18.008844 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-d09df5cf-0247-4420-b532-95f2344b54ce tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:18.018135 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-d09df5cf-0247-4420-b532-95f2344b54ce tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1521 microversion: 2.1 time: 0.202746 Jun 17 11:42:18.020912 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 82/169] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:17 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:18.082995 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-ad00fd38-e1e0-41bf-bd08-0a9cefe6009d req-35773e4b-a4f9-4cdb-9b66-837df4336e37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b237f1d1-5f28-467b-aca8-a2e1d61ec8fa", "name": "network-vif-plugged", "status": "completed", "tag": "f24c26db-fd50-4c00-9701-98f77873ea46"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:42:18.093084 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-ad00fd38-e1e0-41bf-bd08-0a9cefe6009d req-35773e4b-a4f9-4cdb-9b66-837df4336e37 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:18.093517 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-ad00fd38-e1e0-41bf-bd08-0a9cefe6009d req-35773e4b-a4f9-4cdb-9b66-837df4336e37 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:18.105186 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-ad00fd38-e1e0-41bf-bd08-0a9cefe6009d req-35773e4b-a4f9-4cdb-9b66-837df4336e37 service nova] Creating event network-vif-plugged:f24c26db-fd50-4c00-9701-98f77873ea46 for instance b237f1d1-5f28-467b-aca8-a2e1d61ec8fa on hv-cinder-83716 Jun 17 11:42:18.110457 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-ad00fd38-e1e0-41bf-bd08-0a9cefe6009d req-35773e4b-a4f9-4cdb-9b66-837df4336e37 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031579 Jun 17 11:42:18.111154 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 88/170] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:42:18.729584 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e5c0fcca-fd17-44dd-97d9-801bfd628222 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:18.730618 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-e5c0fcca-fd17-44dd-97d9-801bfd628222 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: b237f1d1-5f28-467b-aca8-a2e1d61ec8fa] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:18.737832 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e5c0fcca-fd17-44dd-97d9-801bfd628222 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:18.738578 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e5c0fcca-fd17-44dd-97d9-801bfd628222 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:18.739418 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e5c0fcca-fd17-44dd-97d9-801bfd628222 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:18.739863 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e5c0fcca-fd17-44dd-97d9-801bfd628222 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:18.912842 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-e5c0fcca-fd17-44dd-97d9-801bfd628222 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:18.921187 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-e5c0fcca-fd17-44dd-97d9-801bfd628222 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa" status: 200 len: 1314 microversion: 2.1 time: 0.199585 Jun 17 11:42:18.922637 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 83/171] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:18 2022] GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:19.049465 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-03d84f2d-4abe-4337-acaf-12a3b12762c8 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:19.050161 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-03d84f2d-4abe-4337-acaf-12a3b12762c8 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:19.056637 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-03d84f2d-4abe-4337-acaf-12a3b12762c8 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:19.057205 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-03d84f2d-4abe-4337-acaf-12a3b12762c8 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:19.057979 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-03d84f2d-4abe-4337-acaf-12a3b12762c8 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:19.058413 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-03d84f2d-4abe-4337-acaf-12a3b12762c8 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:19.202993 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-03d84f2d-4abe-4337-acaf-12a3b12762c8 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:19.210794 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-03d84f2d-4abe-4337-acaf-12a3b12762c8 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1521 microversion: 2.1 time: 0.165610 Jun 17 11:42:19.211396 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 89/172] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:19 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:19.939825 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-110bd2a1-a2bb-44d9-8ad5-7b5bcc157965 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:19.940443 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-110bd2a1-a2bb-44d9-8ad5-7b5bcc157965 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: b237f1d1-5f28-467b-aca8-a2e1d61ec8fa] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:19.948095 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-110bd2a1-a2bb-44d9-8ad5-7b5bcc157965 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:19.948919 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-110bd2a1-a2bb-44d9-8ad5-7b5bcc157965 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:19.949833 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-110bd2a1-a2bb-44d9-8ad5-7b5bcc157965 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:19.950771 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-110bd2a1-a2bb-44d9-8ad5-7b5bcc157965 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:20.088746 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-110bd2a1-a2bb-44d9-8ad5-7b5bcc157965 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:20.096318 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-110bd2a1-a2bb-44d9-8ad5-7b5bcc157965 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa" status: 200 len: 1314 microversion: 2.1 time: 0.160800 Jun 17 11:42:20.096899 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 84/173] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:19 2022] GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:20.228873 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5ed84b49-ee8f-425d-8b6a-b9a7853738a2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:20.229875 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-5ed84b49-ee8f-425d-8b6a-b9a7853738a2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:20.235995 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5ed84b49-ee8f-425d-8b6a-b9a7853738a2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:20.236441 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5ed84b49-ee8f-425d-8b6a-b9a7853738a2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:20.237208 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5ed84b49-ee8f-425d-8b6a-b9a7853738a2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:20.237645 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5ed84b49-ee8f-425d-8b6a-b9a7853738a2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:20.378984 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5ed84b49-ee8f-425d-8b6a-b9a7853738a2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:20.386878 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5ed84b49-ee8f-425d-8b6a-b9a7853738a2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1521 microversion: 2.1 time: 0.162611 Jun 17 11:42:20.387551 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 90/174] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:20 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:21.115281 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-5cd3adb6-8836-470e-838a-a08612934399 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:21.116162 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-5cd3adb6-8836-470e-838a-a08612934399 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: b237f1d1-5f28-467b-aca8-a2e1d61ec8fa] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:21.123702 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5cd3adb6-8836-470e-838a-a08612934399 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:21.124154 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5cd3adb6-8836-470e-838a-a08612934399 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:21.124933 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5cd3adb6-8836-470e-838a-a08612934399 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:21.125358 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5cd3adb6-8836-470e-838a-a08612934399 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:21.130204 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=100 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:42:21.260919 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5cd3adb6-8836-470e-838a-a08612934399 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:21.269082 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-5cd3adb6-8836-470e-838a-a08612934399 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa" status: 200 len: 1314 microversion: 2.1 time: 0.157636 Jun 17 11:42:21.269679 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 85/175] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:21 2022] GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:21.404932 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-966df118-8a70-4368-a07f-6b0059f94805 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:21.405700 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-966df118-8a70-4368-a07f-6b0059f94805 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:21.412446 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-966df118-8a70-4368-a07f-6b0059f94805 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:21.412978 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-966df118-8a70-4368-a07f-6b0059f94805 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:21.413898 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-966df118-8a70-4368-a07f-6b0059f94805 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:21.414428 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-966df118-8a70-4368-a07f-6b0059f94805 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:21.633473 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-966df118-8a70-4368-a07f-6b0059f94805 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:21.641562 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-966df118-8a70-4368-a07f-6b0059f94805 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1521 microversion: 2.1 time: 0.240989 Jun 17 11:42:21.642148 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 91/176] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:21 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:22.285925 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4dd992fe-40a6-460d-adbd-c91deb90c518 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:22.286519 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4dd992fe-40a6-460d-adbd-c91deb90c518 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: b237f1d1-5f28-467b-aca8-a2e1d61ec8fa] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:22.294383 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4dd992fe-40a6-460d-adbd-c91deb90c518 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:22.294998 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4dd992fe-40a6-460d-adbd-c91deb90c518 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:22.295821 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4dd992fe-40a6-460d-adbd-c91deb90c518 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:22.296254 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4dd992fe-40a6-460d-adbd-c91deb90c518 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:22.441235 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-4dd992fe-40a6-460d-adbd-c91deb90c518 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:22.450868 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4dd992fe-40a6-460d-adbd-c91deb90c518 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa" status: 200 len: 1314 microversion: 2.1 time: 0.168870 Jun 17 11:42:22.451537 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 86/177] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:22 2022] GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:42:22.660797 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2cec575f-038a-4e47-bdb9-92a792e395d0 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:22.661401 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-2cec575f-038a-4e47-bdb9-92a792e395d0 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:22.668345 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2cec575f-038a-4e47-bdb9-92a792e395d0 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:22.668788 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2cec575f-038a-4e47-bdb9-92a792e395d0 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:22.669561 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2cec575f-038a-4e47-bdb9-92a792e395d0 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:22.669986 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2cec575f-038a-4e47-bdb9-92a792e395d0 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:22.809705 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2cec575f-038a-4e47-bdb9-92a792e395d0 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:22.817559 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2cec575f-038a-4e47-bdb9-92a792e395d0 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1521 microversion: 2.1 time: 0.161487 Jun 17 11:42:22.818133 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 92/178] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:22 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:23.468275 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-af027a18-76da-46bf-8894-2c848e28127d tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:23.468918 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-af027a18-76da-46bf-8894-2c848e28127d tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: b237f1d1-5f28-467b-aca8-a2e1d61ec8fa] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:23.475594 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-af027a18-76da-46bf-8894-2c848e28127d tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:23.476040 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-af027a18-76da-46bf-8894-2c848e28127d tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:23.477486 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-af027a18-76da-46bf-8894-2c848e28127d tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:23.477486 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-af027a18-76da-46bf-8894-2c848e28127d tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:23.614641 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-af027a18-76da-46bf-8894-2c848e28127d tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:23.623176 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-af027a18-76da-46bf-8894-2c848e28127d tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa" status: 200 len: 1314 microversion: 2.1 time: 0.158690 Jun 17 11:42:23.623790 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 87/179] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:23 2022] GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:23.836031 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2fcb43da-3cba-4429-b6a5-2c16e6e76a6e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:23.836611 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-2fcb43da-3cba-4429-b6a5-2c16e6e76a6e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:23.843315 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2fcb43da-3cba-4429-b6a5-2c16e6e76a6e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:23.843796 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2fcb43da-3cba-4429-b6a5-2c16e6e76a6e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:23.844568 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2fcb43da-3cba-4429-b6a5-2c16e6e76a6e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:23.845011 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2fcb43da-3cba-4429-b6a5-2c16e6e76a6e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:23.979573 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2fcb43da-3cba-4429-b6a5-2c16e6e76a6e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:23.988131 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2fcb43da-3cba-4429-b6a5-2c16e6e76a6e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1521 microversion: 2.1 time: 0.155951 Jun 17 11:42:23.988727 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 93/180] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:23 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:24.640079 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-37b966e0-981a-46a8-98ba-94b9212e8066 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:24.640691 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-37b966e0-981a-46a8-98ba-94b9212e8066 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: b237f1d1-5f28-467b-aca8-a2e1d61ec8fa] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:24.647346 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-37b966e0-981a-46a8-98ba-94b9212e8066 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:24.647824 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-37b966e0-981a-46a8-98ba-94b9212e8066 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:24.648593 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-37b966e0-981a-46a8-98ba-94b9212e8066 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:24.649025 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-37b966e0-981a-46a8-98ba-94b9212e8066 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:24.796244 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-37b966e0-981a-46a8-98ba-94b9212e8066 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:24.804298 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-37b966e0-981a-46a8-98ba-94b9212e8066 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa" status: 200 len: 1497 microversion: 2.1 time: 0.167984 Jun 17 11:42:24.804889 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 88/181] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:24 2022] GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:25.007061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b127d7cc-59d0-4386-af08-0682c9bce4e4 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:25.008108 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b127d7cc-59d0-4386-af08-0682c9bce4e4 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:25.015385 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b127d7cc-59d0-4386-af08-0682c9bce4e4 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:25.015856 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b127d7cc-59d0-4386-af08-0682c9bce4e4 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:25.016640 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b127d7cc-59d0-4386-af08-0682c9bce4e4 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:25.017084 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b127d7cc-59d0-4386-af08-0682c9bce4e4 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:25.160404 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b127d7cc-59d0-4386-af08-0682c9bce4e4 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:25.170137 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b127d7cc-59d0-4386-af08-0682c9bce4e4 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1521 microversion: 2.1 time: 0.167991 Jun 17 11:42:25.171035 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 94/182] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:25 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:26.188051 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-cee1221c-bff2-4da9-b4bd-c70b55a99c08 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:26.188718 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-cee1221c-bff2-4da9-b4bd-c70b55a99c08 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:26.195744 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cee1221c-bff2-4da9-b4bd-c70b55a99c08 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:26.196237 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cee1221c-bff2-4da9-b4bd-c70b55a99c08 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:26.197753 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cee1221c-bff2-4da9-b4bd-c70b55a99c08 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:26.198536 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cee1221c-bff2-4da9-b4bd-c70b55a99c08 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:26.366925 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-cee1221c-bff2-4da9-b4bd-c70b55a99c08 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:26.375741 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-cee1221c-bff2-4da9-b4bd-c70b55a99c08 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1521 microversion: 2.1 time: 0.191795 Jun 17 11:42:26.376349 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 89/183] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:26 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:27.394449 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8a46efa6-a422-436b-bf4d-99d0594bbd5f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:27.395148 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-8a46efa6-a422-436b-bf4d-99d0594bbd5f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:27.401549 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8a46efa6-a422-436b-bf4d-99d0594bbd5f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:27.415777 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8a46efa6-a422-436b-bf4d-99d0594bbd5f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:27.415777 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8a46efa6-a422-436b-bf4d-99d0594bbd5f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:27.415777 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8a46efa6-a422-436b-bf4d-99d0594bbd5f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:27.549243 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-8a46efa6-a422-436b-bf4d-99d0594bbd5f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:27.562911 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-8a46efa6-a422-436b-bf4d-99d0594bbd5f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1521 microversion: 2.1 time: 0.172250 Jun 17 11:42:27.563996 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 95/184] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:27 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:28.324829 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-074e1034-ca61-4a40-886a-dca5da180e57 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:28.325713 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-074e1034-ca61-4a40-886a-dca5da180e57 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: b237f1d1-5f28-467b-aca8-a2e1d61ec8fa] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:28.330056 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:42:28.340624 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-074e1034-ca61-4a40-886a-dca5da180e57 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:28.341453 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-074e1034-ca61-4a40-886a-dca5da180e57 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:28.342856 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-074e1034-ca61-4a40-886a-dca5da180e57 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:28.343669 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-074e1034-ca61-4a40-886a-dca5da180e57 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:28.402435 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-074e1034-ca61-4a40-886a-dca5da180e57 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: b237f1d1-5f28-467b-aca8-a2e1d61ec8fa] Going to try to terminate instance {{(pid=124845) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 11:42:28.585933 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-73812a3c-dde6-477a-b636-c9071583bbf3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:28.586586 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-73812a3c-dde6-477a-b636-c9071583bbf3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:28.597035 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-73812a3c-dde6-477a-b636-c9071583bbf3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:28.597759 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-73812a3c-dde6-477a-b636-c9071583bbf3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:28.599038 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-73812a3c-dde6-477a-b636-c9071583bbf3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:28.600054 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-73812a3c-dde6-477a-b636-c9071583bbf3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:28.797618 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-73812a3c-dde6-477a-b636-c9071583bbf3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:28.805849 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-73812a3c-dde6-477a-b636-c9071583bbf3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1521 microversion: 2.1 time: 0.223947 Jun 17 11:42:28.806492 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 96/185] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:28 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:42:28.840773 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-074e1034-ca61-4a40-886a-dca5da180e57 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa" status: 204 len: 0 microversion: 2.1 time: 0.524131 Jun 17 11:42:28.841477 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 90/186] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 17 11:42:28 2022] DELETE /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 11:42:28.850108 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b727ec57-957d-4c52-814f-bcfbee1ee51e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:28.850721 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b727ec57-957d-4c52-814f-bcfbee1ee51e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: b237f1d1-5f28-467b-aca8-a2e1d61ec8fa] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:28.857471 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b727ec57-957d-4c52-814f-bcfbee1ee51e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:28.858861 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b727ec57-957d-4c52-814f-bcfbee1ee51e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:28.860226 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b727ec57-957d-4c52-814f-bcfbee1ee51e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:28.860768 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b727ec57-957d-4c52-814f-bcfbee1ee51e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:29.028527 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b727ec57-957d-4c52-814f-bcfbee1ee51e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:29.034149 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b727ec57-957d-4c52-814f-bcfbee1ee51e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa" status: 200 len: 1503 microversion: 2.1 time: 0.188008 Jun 17 11:42:29.034739 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 97/187] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:28 2022] GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa => generated 1503 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:29.825237 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9c954c25-382f-4a63-9786-5058cd9fdff5 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:29.825968 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9c954c25-382f-4a63-9786-5058cd9fdff5 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:29.833221 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9c954c25-382f-4a63-9786-5058cd9fdff5 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:29.833678 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9c954c25-382f-4a63-9786-5058cd9fdff5 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:29.834446 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9c954c25-382f-4a63-9786-5058cd9fdff5 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:29.836089 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9c954c25-382f-4a63-9786-5058cd9fdff5 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:29.973010 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9c954c25-382f-4a63-9786-5058cd9fdff5 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:29.982076 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9c954c25-382f-4a63-9786-5058cd9fdff5 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1521 microversion: 2.1 time: 0.161483 Jun 17 11:42:29.982670 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 91/188] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:29 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:30.051802 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-81468f46-4b6c-47a2-8258-cf3df2ef99f4 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:30.052359 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-81468f46-4b6c-47a2-8258-cf3df2ef99f4 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: b237f1d1-5f28-467b-aca8-a2e1d61ec8fa] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:30.058867 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-81468f46-4b6c-47a2-8258-cf3df2ef99f4 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:30.061530 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-81468f46-4b6c-47a2-8258-cf3df2ef99f4 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:30.061530 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-81468f46-4b6c-47a2-8258-cf3df2ef99f4 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:30.061530 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-81468f46-4b6c-47a2-8258-cf3df2ef99f4 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:30.364598 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-81468f46-4b6c-47a2-8258-cf3df2ef99f4 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:30.373527 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-81468f46-4b6c-47a2-8258-cf3df2ef99f4 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa" status: 200 len: 1503 microversion: 2.1 time: 0.325946 Jun 17 11:42:30.374124 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 98/189] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:30 2022] GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa => generated 1503 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:31.000088 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ded88b1f-fe70-4984-8e8d-5a0ed03df626 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:31.000775 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-ded88b1f-fe70-4984-8e8d-5a0ed03df626 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:31.008157 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ded88b1f-fe70-4984-8e8d-5a0ed03df626 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:31.008645 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ded88b1f-fe70-4984-8e8d-5a0ed03df626 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:31.009517 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ded88b1f-fe70-4984-8e8d-5a0ed03df626 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:31.010492 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ded88b1f-fe70-4984-8e8d-5a0ed03df626 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:31.179733 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ded88b1f-fe70-4984-8e8d-5a0ed03df626 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:31.188154 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-ded88b1f-fe70-4984-8e8d-5a0ed03df626 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1521 microversion: 2.1 time: 0.192037 Jun 17 11:42:31.188747 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 92/190] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:30 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:31.391861 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-496b82fd-64e3-45e4-9e33-8364124c6c17 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:31.392635 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-496b82fd-64e3-45e4-9e33-8364124c6c17 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: b237f1d1-5f28-467b-aca8-a2e1d61ec8fa] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:31.399013 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-496b82fd-64e3-45e4-9e33-8364124c6c17 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:31.399501 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-496b82fd-64e3-45e4-9e33-8364124c6c17 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:31.400305 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-496b82fd-64e3-45e4-9e33-8364124c6c17 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:31.400773 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-496b82fd-64e3-45e4-9e33-8364124c6c17 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:31.537440 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-496b82fd-64e3-45e4-9e33-8364124c6c17 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:31.545754 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-496b82fd-64e3-45e4-9e33-8364124c6c17 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa" status: 200 len: 1503 microversion: 2.1 time: 0.158100 Jun 17 11:42:31.546324 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 99/191] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:31 2022] GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:32.206258 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-5b724857-b3f3-45d3-badd-71eb142eeae9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:32.206874 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-5b724857-b3f3-45d3-badd-71eb142eeae9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:32.214634 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5b724857-b3f3-45d3-badd-71eb142eeae9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:32.215086 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5b724857-b3f3-45d3-badd-71eb142eeae9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:32.215976 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5b724857-b3f3-45d3-badd-71eb142eeae9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:32.216412 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5b724857-b3f3-45d3-badd-71eb142eeae9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:32.389181 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5b724857-b3f3-45d3-badd-71eb142eeae9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:32.404000 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-5b724857-b3f3-45d3-badd-71eb142eeae9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1521 microversion: 2.1 time: 0.201494 Jun 17 11:42:32.404604 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 93/192] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:32 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:32.562167 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1a32808b-92ef-46cc-b207-be1822de706e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:32.562787 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-1a32808b-92ef-46cc-b207-be1822de706e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: b237f1d1-5f28-467b-aca8-a2e1d61ec8fa] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:32.569321 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1a32808b-92ef-46cc-b207-be1822de706e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:32.569855 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1a32808b-92ef-46cc-b207-be1822de706e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:32.570666 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1a32808b-92ef-46cc-b207-be1822de706e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:32.571102 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1a32808b-92ef-46cc-b207-be1822de706e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:32.588802 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=100 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:42:32.715750 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-1a32808b-92ef-46cc-b207-be1822de706e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:32.723817 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-1a32808b-92ef-46cc-b207-be1822de706e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa" status: 200 len: 1503 microversion: 2.1 time: 0.165401 Jun 17 11:42:32.724409 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 100/193] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:32 2022] GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:33.424769 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-26228fac-094e-4409-86d9-3579059db859 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:33.425982 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-26228fac-094e-4409-86d9-3579059db859 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:33.435136 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-26228fac-094e-4409-86d9-3579059db859 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:33.435890 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-26228fac-094e-4409-86d9-3579059db859 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:33.437236 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-26228fac-094e-4409-86d9-3579059db859 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:33.439851 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-26228fac-094e-4409-86d9-3579059db859 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:33.641913 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-26228fac-094e-4409-86d9-3579059db859 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:33.654688 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-26228fac-094e-4409-86d9-3579059db859 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1521 microversion: 2.1 time: 0.235782 Jun 17 11:42:33.655887 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 94/194] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:33 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:33.742080 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-750db960-6f51-4a6f-a673-50ee3ef50d33 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:33.742747 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-750db960-6f51-4a6f-a673-50ee3ef50d33 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: b237f1d1-5f28-467b-aca8-a2e1d61ec8fa] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:33.750184 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-750db960-6f51-4a6f-a673-50ee3ef50d33 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:33.750675 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-750db960-6f51-4a6f-a673-50ee3ef50d33 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:33.751563 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-750db960-6f51-4a6f-a673-50ee3ef50d33 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:33.752047 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-750db960-6f51-4a6f-a673-50ee3ef50d33 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:33.936663 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-750db960-6f51-4a6f-a673-50ee3ef50d33 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:33.944931 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-750db960-6f51-4a6f-a673-50ee3ef50d33 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa" status: 200 len: 1503 microversion: 2.1 time: 0.207120 Jun 17 11:42:33.945512 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 101/195] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:33 2022] GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa => generated 1503 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:34.673692 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e7dbb42d-a66b-4e04-bcc0-f2401251fd1c tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:34.674332 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-e7dbb42d-a66b-4e04-bcc0-f2401251fd1c tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:34.681500 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e7dbb42d-a66b-4e04-bcc0-f2401251fd1c tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:34.682047 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e7dbb42d-a66b-4e04-bcc0-f2401251fd1c tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:34.682840 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e7dbb42d-a66b-4e04-bcc0-f2401251fd1c tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:34.683601 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e7dbb42d-a66b-4e04-bcc0-f2401251fd1c tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:34.964510 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d113aca4-cd5e-4db7-a636-8710772ae425 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:34.965737 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d113aca4-cd5e-4db7-a636-8710772ae425 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: b237f1d1-5f28-467b-aca8-a2e1d61ec8fa] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:34.973974 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d113aca4-cd5e-4db7-a636-8710772ae425 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:34.974906 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d113aca4-cd5e-4db7-a636-8710772ae425 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:34.975673 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d113aca4-cd5e-4db7-a636-8710772ae425 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:34.976300 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d113aca4-cd5e-4db7-a636-8710772ae425 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:34.992187 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-e7dbb42d-a66b-4e04-bcc0-f2401251fd1c tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:35.003477 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-e7dbb42d-a66b-4e04-bcc0-f2401251fd1c tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1521 microversion: 2.1 time: 0.333617 Jun 17 11:42:35.004467 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 95/196] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:34 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:35.126874 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d113aca4-cd5e-4db7-a636-8710772ae425 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:35.135038 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d113aca4-cd5e-4db7-a636-8710772ae425 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa" status: 200 len: 1503 microversion: 2.1 time: 0.176726 Jun 17 11:42:35.135877 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 102/197] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:34 2022] GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa => generated 1503 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:42:36.028634 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-412dd93c-8a97-48ae-88d3-11b8f91747d6 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:36.029337 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-412dd93c-8a97-48ae-88d3-11b8f91747d6 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:36.038050 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-412dd93c-8a97-48ae-88d3-11b8f91747d6 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:36.038805 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-412dd93c-8a97-48ae-88d3-11b8f91747d6 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:36.040362 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-412dd93c-8a97-48ae-88d3-11b8f91747d6 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:36.040924 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-412dd93c-8a97-48ae-88d3-11b8f91747d6 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:36.158070 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8ea72054-ad77-424b-b123-c612bbab3501 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:36.161101 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-8ea72054-ad77-424b-b123-c612bbab3501 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: b237f1d1-5f28-467b-aca8-a2e1d61ec8fa] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:36.171384 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8ea72054-ad77-424b-b123-c612bbab3501 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:36.172209 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8ea72054-ad77-424b-b123-c612bbab3501 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:36.173653 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8ea72054-ad77-424b-b123-c612bbab3501 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:36.174440 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8ea72054-ad77-424b-b123-c612bbab3501 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:36.290749 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-8ea72054-ad77-424b-b123-c612bbab3501 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:36.305972 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-8ea72054-ad77-424b-b123-c612bbab3501 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa" status: 200 len: 1461 microversion: 2.1 time: 0.155596 Jun 17 11:42:36.316084 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 103/198] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:36 2022] GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa => generated 1461 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:36.316497 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-2153cbae-fcfa-4365-8ce6-ebdf4975c57e req-b199a97e-173e-445d-9109-e25780a4c4aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b237f1d1-5f28-467b-aca8-a2e1d61ec8fa", "name": "network-vif-deleted", "tag": "f24c26db-fd50-4c00-9701-98f77873ea46"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:42:36.332964 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-2153cbae-fcfa-4365-8ce6-ebdf4975c57e req-b199a97e-173e-445d-9109-e25780a4c4aa service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:36.333755 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-2153cbae-fcfa-4365-8ce6-ebdf4975c57e req-b199a97e-173e-445d-9109-e25780a4c4aa service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:36.334992 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-412dd93c-8a97-48ae-88d3-11b8f91747d6 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:36.344227 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-412dd93c-8a97-48ae-88d3-11b8f91747d6 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1521 microversion: 2.1 time: 0.320129 Jun 17 11:42:36.344818 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 96/199] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:36 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:36.360178 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-2153cbae-fcfa-4365-8ce6-ebdf4975c57e req-b199a97e-173e-445d-9109-e25780a4c4aa service nova] Creating event network-vif-deleted:f24c26db-fd50-4c00-9701-98f77873ea46 for instance b237f1d1-5f28-467b-aca8-a2e1d61ec8fa on hv-cinder-83716 Jun 17 11:42:36.369105 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-2153cbae-fcfa-4365-8ce6-ebdf4975c57e req-b199a97e-173e-445d-9109-e25780a4c4aa service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059160 Jun 17 11:42:36.370183 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 104/200] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:42:37.324539 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-3c751ffa-a008-4243-a09c-6d7f43c4c19a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:37.325198 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-3c751ffa-a008-4243-a09c-6d7f43c4c19a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: b237f1d1-5f28-467b-aca8-a2e1d61ec8fa] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:37.332480 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3c751ffa-a008-4243-a09c-6d7f43c4c19a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:37.332935 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3c751ffa-a008-4243-a09c-6d7f43c4c19a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:37.333725 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3c751ffa-a008-4243-a09c-6d7f43c4c19a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:37.334166 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3c751ffa-a008-4243-a09c-6d7f43c4c19a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:37.367489 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c7980cad-16fb-468a-b393-3de8e401433a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:37.368760 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c7980cad-16fb-468a-b393-3de8e401433a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:37.380730 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c7980cad-16fb-468a-b393-3de8e401433a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:37.381548 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c7980cad-16fb-468a-b393-3de8e401433a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:37.382971 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c7980cad-16fb-468a-b393-3de8e401433a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:37.383769 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c7980cad-16fb-468a-b393-3de8e401433a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:37.405801 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-3c751ffa-a008-4243-a09c-6d7f43c4c19a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:37.415090 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-3c751ffa-a008-4243-a09c-6d7f43c4c19a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa" status: 200 len: 1299 microversion: 2.1 time: 0.094617 Jun 17 11:42:37.419857 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 97/201] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:37 2022] GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa => generated 1299 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:42:37.556061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c7980cad-16fb-468a-b393-3de8e401433a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:37.566803 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c7980cad-16fb-468a-b393-3de8e401433a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1521 microversion: 2.1 time: 0.207919 Jun 17 11:42:37.568945 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 105/202] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:37 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:42:38.442448 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-233e6579-1b6d-4ba2-ba19-9593db3763d9 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:38.443130 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-233e6579-1b6d-4ba2-ba19-9593db3763d9 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: b237f1d1-5f28-467b-aca8-a2e1d61ec8fa] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:38.452016 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-233e6579-1b6d-4ba2-ba19-9593db3763d9 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:38.452507 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-233e6579-1b6d-4ba2-ba19-9593db3763d9 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:38.453346 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-233e6579-1b6d-4ba2-ba19-9593db3763d9 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:38.453889 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-233e6579-1b6d-4ba2-ba19-9593db3763d9 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:38.522885 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-233e6579-1b6d-4ba2-ba19-9593db3763d9 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:38.532299 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-233e6579-1b6d-4ba2-ba19-9593db3763d9 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa" status: 200 len: 1299 microversion: 2.1 time: 0.093967 Jun 17 11:42:38.532894 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 98/203] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:38 2022] GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa => generated 1299 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:38.595002 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a9bbc44a-b39c-4cfb-9f0e-ff0c68165400 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:38.596020 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a9bbc44a-b39c-4cfb-9f0e-ff0c68165400 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:38.598493 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=64 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:42:38.605814 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a9bbc44a-b39c-4cfb-9f0e-ff0c68165400 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:38.606533 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a9bbc44a-b39c-4cfb-9f0e-ff0c68165400 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:38.608057 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a9bbc44a-b39c-4cfb-9f0e-ff0c68165400 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:38.608751 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a9bbc44a-b39c-4cfb-9f0e-ff0c68165400 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:38.788827 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a9bbc44a-b39c-4cfb-9f0e-ff0c68165400 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:38.798318 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a9bbc44a-b39c-4cfb-9f0e-ff0c68165400 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1521 microversion: 2.1 time: 0.207572 Jun 17 11:42:38.798998 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 106/204] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:38 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:39.564380 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9841e692-0a0a-4b3c-9737-239bdf9ca1d5 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:39.565223 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9841e692-0a0a-4b3c-9737-239bdf9ca1d5 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: b237f1d1-5f28-467b-aca8-a2e1d61ec8fa] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:39.572372 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9841e692-0a0a-4b3c-9737-239bdf9ca1d5 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:39.573348 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9841e692-0a0a-4b3c-9737-239bdf9ca1d5 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:39.574180 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9841e692-0a0a-4b3c-9737-239bdf9ca1d5 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:39.574614 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9841e692-0a0a-4b3c-9737-239bdf9ca1d5 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:39.611036 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9841e692-0a0a-4b3c-9737-239bdf9ca1d5 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:39.612079 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9841e692-0a0a-4b3c-9737-239bdf9ca1d5 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:39.612924 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-9841e692-0a0a-4b3c-9737-239bdf9ca1d5 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lazy-loading 'fault' on Instance uuid b237f1d1-5f28-467b-aca8-a2e1d61ec8fa {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:42:39.674563 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9841e692-0a0a-4b3c-9737-239bdf9ca1d5 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:39.677941 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:42:39.684044 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9841e692-0a0a-4b3c-9737-239bdf9ca1d5 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa" status: 200 len: 1304 microversion: 2.1 time: 0.128045 Jun 17 11:42:39.684674 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 99/205] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:39 2022] GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa => generated 1304 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:39.817530 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4cacd4b3-9a33-4271-9201-3ab2d4e847f9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:39.818248 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4cacd4b3-9a33-4271-9201-3ab2d4e847f9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:39.826196 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4cacd4b3-9a33-4271-9201-3ab2d4e847f9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:39.826795 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4cacd4b3-9a33-4271-9201-3ab2d4e847f9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:39.827644 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4cacd4b3-9a33-4271-9201-3ab2d4e847f9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:39.828085 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4cacd4b3-9a33-4271-9201-3ab2d4e847f9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:39.984436 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4cacd4b3-9a33-4271-9201-3ab2d4e847f9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:39.992862 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4cacd4b3-9a33-4271-9201-3ab2d4e847f9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1521 microversion: 2.1 time: 0.179379 Jun 17 11:42:39.993516 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 107/206] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:39 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:42:40.711453 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-1e22b18f-e169-4ac3-80f1-3427f0188229 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:40.712133 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-1e22b18f-e169-4ac3-80f1-3427f0188229 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: b237f1d1-5f28-467b-aca8-a2e1d61ec8fa] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:40.721223 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1e22b18f-e169-4ac3-80f1-3427f0188229 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:40.721662 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1e22b18f-e169-4ac3-80f1-3427f0188229 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:40.722448 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1e22b18f-e169-4ac3-80f1-3427f0188229 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:40.722885 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1e22b18f-e169-4ac3-80f1-3427f0188229 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:40.829640 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1e22b18f-e169-4ac3-80f1-3427f0188229 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:40.830370 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1e22b18f-e169-4ac3-80f1-3427f0188229 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:40.831137 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-1e22b18f-e169-4ac3-80f1-3427f0188229 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lazy-loading 'fault' on Instance uuid b237f1d1-5f28-467b-aca8-a2e1d61ec8fa {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:42:40.953856 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-1e22b18f-e169-4ac3-80f1-3427f0188229 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:40.964488 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-1e22b18f-e169-4ac3-80f1-3427f0188229 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa" status: 200 len: 1304 microversion: 2.1 time: 0.256050 Jun 17 11:42:40.965455 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 100/207] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:40 2022] GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa => generated 1304 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:42:41.014591 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3b26610a-eb29-4716-a46d-1061da2913bc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:41.020989 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-3b26610a-eb29-4716-a46d-1061da2913bc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:41.022912 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3b26610a-eb29-4716-a46d-1061da2913bc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:41.023481 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3b26610a-eb29-4716-a46d-1061da2913bc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:41.024360 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3b26610a-eb29-4716-a46d-1061da2913bc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:41.024876 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3b26610a-eb29-4716-a46d-1061da2913bc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:41.222569 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3b26610a-eb29-4716-a46d-1061da2913bc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:41.232416 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-3b26610a-eb29-4716-a46d-1061da2913bc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1521 microversion: 2.1 time: 0.223724 Jun 17 11:42:41.233006 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 108/208] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:41 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:42:41.985371 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8b17b746-b51e-431c-9356-36e8fa74287f tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:41.986410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-8b17b746-b51e-431c-9356-36e8fa74287f tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: b237f1d1-5f28-467b-aca8-a2e1d61ec8fa] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:41.995900 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8b17b746-b51e-431c-9356-36e8fa74287f tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:41.996436 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8b17b746-b51e-431c-9356-36e8fa74287f tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:41.997288 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8b17b746-b51e-431c-9356-36e8fa74287f tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:41.997790 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8b17b746-b51e-431c-9356-36e8fa74287f tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:42.019559 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-8b17b746-b51e-431c-9356-36e8fa74287f tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] HTTP exception thrown: Instance b237f1d1-5f28-467b-aca8-a2e1d61ec8fa could not be found. Jun 17 11:42:42.022984 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8b17b746-b51e-431c-9356-36e8fa74287f tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Request method failure captured: Jun 17 11:42:42.022984 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa HTTP/1.1 Jun 17 11:42:42.022984 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jun 17 11:42:42.022984 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jun 17 11:42:42.022984 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Connection: close Jun 17 11:42:42.022984 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jun 17 11:42:42.022984 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jun 17 11:42:42.022984 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.45 Jun 17 11:42:42.022984 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jun 17 11:42:42.022984 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jun 17 11:42:42.022984 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABirGiKy1QsHKBuFdJnSODOSOGzT8bbjShv7IIMB-edyBDwOk4fK3Y69h5XhIK1PQ5Is6BujRjzqesLOPnSMG8LxCOuRSxjf-kj4vJtUkFjRNqi2IhLLozUsOt9okpSX9Zy4JdhV8SchfGDvypI_Y-hfDzhzS8dbnu9NRM1_OZQ-6dJrJw Jun 17 11:42:42.022984 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jun 17 11:42:42.022984 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jun 17 11:42:42.022984 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jun 17 11:42:42.022984 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jun 17 11:42:42.022984 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jun 17 11:42:42.022984 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jun 17 11:42:42.022984 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Id: b1c1e0064ef5486795031aff48250978 Jun 17 11:42:42.022984 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-VolumesActionsTest-1960376485 Jun 17 11:42:42.022984 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jun 17 11:42:42.022984 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jun 17 11:42:42.025511 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b1c1e0064ef5486795031aff48250978"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b1c1e0064ef5486795031aff48250978", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b1c1e0064ef5486795031aff48250978"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b1c1e0064ef5486795031aff48250978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:42:42.025511 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-VolumesActionsTest-1960376485 Jun 17 11:42:42.025511 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: b1c1e0064ef5486795031aff48250978 Jun 17 11:42:42.025511 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-VolumesActionsTest-1960376485 Jun 17 11:42:42.025511 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User: tempest-VolumesActionsTest-1960376485-project Jun 17 11:42:42.025511 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jun 17 11:42:42.025511 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jun 17 11:42:42.025511 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Id: ee6039f599d44024ac3fdd6cbb65e62f Jun 17 11:42:42.025511 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-VolumesActionsTest-1960376485-project Jun 17 11:42:42.025511 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: method: > Jun 17 11:42:42.025511 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: exception: Instance b237f1d1-5f28-467b-aca8-a2e1d61ec8fa could not be found. Jun 17 11:42:42.025511 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: action_args: {'id': 'b237f1d1-5f28-467b-aca8-a2e1d61ec8fa'} Jun 17 11:42:42.027885 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:42:42.027885 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:42:42.027885 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:42:42.027885 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:42:42.027885 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:42:42.027885 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:42:42.027885 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:42:42.027885 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:42:42.027885 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:42:42.027885 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:42:42.027885 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b237f1d1-5f28-467b-aca8-a2e1d61ec8fa could not be found. Jun 17 11:42:42.027885 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:42:42.027885 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:42:42.027885 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:42:42.027885 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:42:42.027885 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:42:42.027885 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:42:42.027885 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:42:42.027885 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:42:42.027885 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:42:42.042515 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:42:42.042515 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 11:42:42.042515 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 11:42:42.042515 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:42:42.042515 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:42:42.042515 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:42:42.042515 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:42:42.042515 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b237f1d1-5f28-467b-aca8-a2e1d61ec8fa could not be found. Jun 17 11:42:42.042515 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:42:42.042515 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:42:42.042515 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:42:42.042515 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:42:42.042515 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:42:42.042515 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:42:42.042515 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:42:42.042515 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:42:42.042515 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b237f1d1-5f28-467b-aca8-a2e1d61ec8fa could not be found. Jun 17 11:42:42.042515 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:42:42.046217 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8b17b746-b51e-431c-9356-36e8fa74287f tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Returning 404 to user: Instance b237f1d1-5f28-467b-aca8-a2e1d61ec8fa could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:42:42.046217 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-8b17b746-b51e-431c-9356-36e8fa74287f tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa" status: 404 len: 111 microversion: 2.1 time: 0.046313 Jun 17 11:42:42.046217 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 101/209] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:41 2022] GET /compute/v2.1/servers/b237f1d1-5f28-467b-aca8-a2e1d61ec8fa => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:42:42.183975 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a7cbcc06-9675-4f15-9482-b1ad9c97cc0d tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1812211060", "imageRef": "272eb2b7-ddf0-433f-8be8-cdc13c01be77", "flavorRef": "452", "networks": [{"uuid": "c6f48b6e-5e75-4a43-91dd-a0b6f2a37841"}]}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:42:42.253123 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-3ed519f4-0718-4270-91be-8e46d37543e1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:42.253748 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-3ed519f4-0718-4270-91be-8e46d37543e1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:42.262498 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3ed519f4-0718-4270-91be-8e46d37543e1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:42.268331 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3ed519f4-0718-4270-91be-8e46d37543e1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:42.269476 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3ed519f4-0718-4270-91be-8e46d37543e1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:42.269925 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3ed519f4-0718-4270-91be-8e46d37543e1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:42.275196 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.network.neutron [None req-a7cbcc06-9675-4f15-9482-b1ad9c97cc0d tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] validate_networks() for [('c6f48b6e-5e75-4a43-91dd-a0b6f2a37841', None, None, None, None, None)] {{(pid=124844) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 11:42:42.551252 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-3ed519f4-0718-4270-91be-8e46d37543e1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:42.567657 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-3ed519f4-0718-4270-91be-8e46d37543e1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1521 microversion: 2.1 time: 0.318472 Jun 17 11:42:42.570733 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 102/210] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:42 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:43.096222 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-a7cbcc06-9675-4f15-9482-b1ad9c97cc0d tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Flavor limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 11:42:43.096790 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-a7cbcc06-9675-4f15-9482-b1ad9c97cc0d tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Image limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 11:42:43.097499 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-a7cbcc06-9675-4f15-9482-b1ad9c97cc0d tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Flavor pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 11:42:43.098071 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-a7cbcc06-9675-4f15-9482-b1ad9c97cc0d tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Image pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 11:42:43.098632 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-a7cbcc06-9675-4f15-9482-b1ad9c97cc0d tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 11:42:43.110791 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a7cbcc06-9675-4f15-9482-b1ad9c97cc0d tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:43.111234 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a7cbcc06-9675-4f15-9482-b1ad9c97cc0d tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:43.112073 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a7cbcc06-9675-4f15-9482-b1ad9c97cc0d tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:43.112600 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a7cbcc06-9675-4f15-9482-b1ad9c97cc0d tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:43.134129 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-a7cbcc06-9675-4f15-9482-b1ad9c97cc0d tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Getting quotas for project b1c1e0064ef5486795031aff48250978. Resources: {'instances', 'ram', 'cores'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 11:42:43.139394 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-a7cbcc06-9675-4f15-9482-b1ad9c97cc0d tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Getting quotas for user ee6039f599d44024ac3fdd6cbb65e62f and project b1c1e0064ef5486795031aff48250978. Resources: {'instances', 'ram', 'cores'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 11:42:43.152016 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a7cbcc06-9675-4f15-9482-b1ad9c97cc0d tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Going to run 1 instances... {{(pid=124844) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 11:42:43.154763 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a7cbcc06-9675-4f15-9482-b1ad9c97cc0d tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: 071dafa3-1567-400a-91f3-600420a0e708] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='272eb2b7-ddf0-433f-8be8-cdc13c01be77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 11:42:43.347161 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a7cbcc06-9675-4f15-9482-b1ad9c97cc0d tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.168094 Jun 17 11:42:43.348223 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 109/211] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 17 11:42:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 17 11:42:43.360183 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9e3f2a69-a019-4a7f-94d8-f70a12601261 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:43.361517 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9e3f2a69-a019-4a7f-94d8-f70a12601261 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: 071dafa3-1567-400a-91f3-600420a0e708] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:43.449147 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9e3f2a69-a019-4a7f-94d8-f70a12601261 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:43.460688 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9e3f2a69-a019-4a7f-94d8-f70a12601261 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708" status: 200 len: 1214 microversion: 2.1 time: 0.106082 Jun 17 11:42:43.461617 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 103/212] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:43 2022] GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708 => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:43.596296 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-78e03c5a-926b-4cd1-bc9d-bb8e8a3aa2cb tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:43.596887 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-78e03c5a-926b-4cd1-bc9d-bb8e8a3aa2cb tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:43.603692 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-78e03c5a-926b-4cd1-bc9d-bb8e8a3aa2cb tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:43.605185 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-78e03c5a-926b-4cd1-bc9d-bb8e8a3aa2cb tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:43.606977 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-78e03c5a-926b-4cd1-bc9d-bb8e8a3aa2cb tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:43.607522 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-78e03c5a-926b-4cd1-bc9d-bb8e8a3aa2cb tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:43.798975 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-78e03c5a-926b-4cd1-bc9d-bb8e8a3aa2cb tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:43.808029 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-78e03c5a-926b-4cd1-bc9d-bb8e8a3aa2cb tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1501 microversion: 2.1 time: 0.215410 Jun 17 11:42:43.808698 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 110/213] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:43 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1501 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:43.828944 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-d96e200e-32f1-4320-99f3-085dc7477e6f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:43.830788 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-d96e200e-32f1-4320-99f3-085dc7477e6f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:43.838139 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d96e200e-32f1-4320-99f3-085dc7477e6f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:43.838984 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d96e200e-32f1-4320-99f3-085dc7477e6f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:43.839968 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d96e200e-32f1-4320-99f3-085dc7477e6f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:43.840419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d96e200e-32f1-4320-99f3-085dc7477e6f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:44.024062 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-d96e200e-32f1-4320-99f3-085dc7477e6f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:44.039960 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-d96e200e-32f1-4320-99f3-085dc7477e6f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74" status: 200 len: 1516 microversion: 2.1 time: 0.218195 Jun 17 11:42:44.041091 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 104/214] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:43 2022] GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74 => generated 1516 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:44.482372 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-492af116-6d5c-4b85-96e0-fd1f52f81fba tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:44.483234 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-492af116-6d5c-4b85-96e0-fd1f52f81fba tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: 071dafa3-1567-400a-91f3-600420a0e708] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:44.548902 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-492af116-6d5c-4b85-96e0-fd1f52f81fba tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:44.559007 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-492af116-6d5c-4b85-96e0-fd1f52f81fba tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708" status: 200 len: 1214 microversion: 2.1 time: 0.080822 Jun 17 11:42:44.560430 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 111/215] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:44 2022] GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:45.577109 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-69934a6f-3491-4746-84e1-2ee2b955b2d1 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:45.578122 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-69934a6f-3491-4746-84e1-2ee2b955b2d1 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: 071dafa3-1567-400a-91f3-600420a0e708] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:45.586465 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-69934a6f-3491-4746-84e1-2ee2b955b2d1 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:45.586932 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-69934a6f-3491-4746-84e1-2ee2b955b2d1 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:45.587836 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-69934a6f-3491-4746-84e1-2ee2b955b2d1 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:45.588279 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-69934a6f-3491-4746-84e1-2ee2b955b2d1 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:45.662120 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-69934a6f-3491-4746-84e1-2ee2b955b2d1 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:45.677144 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-69934a6f-3491-4746-84e1-2ee2b955b2d1 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708" status: 200 len: 1218 microversion: 2.1 time: 0.104115 Jun 17 11:42:45.678238 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 105/216] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:45 2022] GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708 => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:42:46.696266 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-eed1cdfa-3d61-4168-8326-62f1441cc500 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:46.697230 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-eed1cdfa-3d61-4168-8326-62f1441cc500 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: 071dafa3-1567-400a-91f3-600420a0e708] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:46.706326 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-eed1cdfa-3d61-4168-8326-62f1441cc500 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:46.706948 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-eed1cdfa-3d61-4168-8326-62f1441cc500 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:46.709132 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-eed1cdfa-3d61-4168-8326-62f1441cc500 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:46.713294 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-eed1cdfa-3d61-4168-8326-62f1441cc500 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:46.794089 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-eed1cdfa-3d61-4168-8326-62f1441cc500 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:46.800297 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-eed1cdfa-3d61-4168-8326-62f1441cc500 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708" status: 200 len: 1266 microversion: 2.1 time: 0.108507 Jun 17 11:42:46.800913 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 112/217] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:46 2022] GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708 => generated 1266 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:47.822865 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9af1f66b-a2d4-44fc-9235-0c286a753017 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:47.824539 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9af1f66b-a2d4-44fc-9235-0c286a753017 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: 071dafa3-1567-400a-91f3-600420a0e708] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:47.836619 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9af1f66b-a2d4-44fc-9235-0c286a753017 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:47.837394 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9af1f66b-a2d4-44fc-9235-0c286a753017 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:47.839554 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9af1f66b-a2d4-44fc-9235-0c286a753017 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:47.840376 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9af1f66b-a2d4-44fc-9235-0c286a753017 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:47.918759 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9af1f66b-a2d4-44fc-9235-0c286a753017 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:47.933140 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9af1f66b-a2d4-44fc-9235-0c286a753017 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708" status: 200 len: 1266 microversion: 2.1 time: 0.117249 Jun 17 11:42:47.934280 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 106/218] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:47 2022] GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708 => generated 1266 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:48.958104 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-cbfbd186-41eb-4fbf-af3e-d4b584a5b4c9 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:48.958847 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-cbfbd186-41eb-4fbf-af3e-d4b584a5b4c9 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: 071dafa3-1567-400a-91f3-600420a0e708] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:48.966331 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cbfbd186-41eb-4fbf-af3e-d4b584a5b4c9 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:48.966786 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cbfbd186-41eb-4fbf-af3e-d4b584a5b4c9 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:48.967633 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cbfbd186-41eb-4fbf-af3e-d4b584a5b4c9 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:48.968149 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cbfbd186-41eb-4fbf-af3e-d4b584a5b4c9 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:49.043708 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-cbfbd186-41eb-4fbf-af3e-d4b584a5b4c9 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:49.052320 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-cbfbd186-41eb-4fbf-af3e-d4b584a5b4c9 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708" status: 200 len: 1266 microversion: 2.1 time: 0.098118 Jun 17 11:42:49.058888 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 113/219] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:48 2022] GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708 => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:50.078897 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4a2977ed-920f-470d-b27e-ae4beafa1ed4 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:50.080042 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4a2977ed-920f-470d-b27e-ae4beafa1ed4 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: 071dafa3-1567-400a-91f3-600420a0e708] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:50.091825 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4a2977ed-920f-470d-b27e-ae4beafa1ed4 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:50.092632 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4a2977ed-920f-470d-b27e-ae4beafa1ed4 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:50.094035 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4a2977ed-920f-470d-b27e-ae4beafa1ed4 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:50.094816 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4a2977ed-920f-470d-b27e-ae4beafa1ed4 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:50.214221 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-4a2977ed-920f-470d-b27e-ae4beafa1ed4 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:50.222908 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4a2977ed-920f-470d-b27e-ae4beafa1ed4 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708" status: 200 len: 1274 microversion: 2.1 time: 0.151858 Jun 17 11:42:50.223936 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 107/220] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:50 2022] GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708 => generated 1274 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:50.357668 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e793d9c6-6eb2-4ff3-98d1-49dafdc11a77 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:42:50.359498 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e793d9c6-6eb2-4ff3-98d1-49dafdc11a77 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:50.367974 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e793d9c6-6eb2-4ff3-98d1-49dafdc11a77 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:50.368702 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e793d9c6-6eb2-4ff3-98d1-49dafdc11a77 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:50.371520 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e793d9c6-6eb2-4ff3-98d1-49dafdc11a77 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:50.372792 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e793d9c6-6eb2-4ff3-98d1-49dafdc11a77 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:50.405229 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-e793d9c6-6eb2-4ff3-98d1-49dafdc11a77 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lazy-loading 'flavor' on Instance uuid 39a1319f-9f84-46db-9981-30ff7e4acc74 {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:42:50.796245 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e793d9c6-6eb2-4ff3-98d1-49dafdc11a77 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "POST /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74/action" status: 200 len: 32 microversion: 2.1 time: 0.443825 Jun 17 11:42:50.797483 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 114/221] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jun 17 11:42:50 2022] POST /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74/action => generated 32 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 17 11:42:50.810835 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-21e14763-fb0d-40c1-bbb9-815d8c9e95fd tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:50.812477 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-21e14763-fb0d-40c1-bbb9-815d8c9e95fd tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:50.821521 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-21e14763-fb0d-40c1-bbb9-815d8c9e95fd tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:50.823622 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-21e14763-fb0d-40c1-bbb9-815d8c9e95fd tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:50.825345 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-21e14763-fb0d-40c1-bbb9-815d8c9e95fd tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:50.826374 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-21e14763-fb0d-40c1-bbb9-815d8c9e95fd tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:51.142794 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-21e14763-fb0d-40c1-bbb9-815d8c9e95fd tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:51.151376 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-21e14763-fb0d-40c1-bbb9-815d8c9e95fd tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74" status: 200 len: 1522 microversion: 2.1 time: 0.345330 Jun 17 11:42:51.151936 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 108/222] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:50 2022] GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74 => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:51.250265 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-817d0204-6e6e-4fff-b6d4-0b338b874fce tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:51.251089 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-817d0204-6e6e-4fff-b6d4-0b338b874fce tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: 071dafa3-1567-400a-91f3-600420a0e708] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:51.258167 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-817d0204-6e6e-4fff-b6d4-0b338b874fce tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:51.258618 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-817d0204-6e6e-4fff-b6d4-0b338b874fce tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:51.259446 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-817d0204-6e6e-4fff-b6d4-0b338b874fce tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:51.259882 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-817d0204-6e6e-4fff-b6d4-0b338b874fce tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:51.349486 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-817d0204-6e6e-4fff-b6d4-0b338b874fce tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:51.360103 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-817d0204-6e6e-4fff-b6d4-0b338b874fce tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708" status: 200 len: 1272 microversion: 2.1 time: 0.114628 Jun 17 11:42:51.360867 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 115/223] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:51 2022] GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708 => generated 1272 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:42:52.173722 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-69e5590c-9ecb-4472-97a3-cd82bbf4d7af tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:52.174836 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-69e5590c-9ecb-4472-97a3-cd82bbf4d7af tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:52.187765 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-69e5590c-9ecb-4472-97a3-cd82bbf4d7af tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:52.189028 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-69e5590c-9ecb-4472-97a3-cd82bbf4d7af tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:52.190553 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-69e5590c-9ecb-4472-97a3-cd82bbf4d7af tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:52.191425 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-69e5590c-9ecb-4472-97a3-cd82bbf4d7af tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:52.380490 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f97c7b9c-3341-4246-807f-5fdabecccad2 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:52.381491 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f97c7b9c-3341-4246-807f-5fdabecccad2 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: 071dafa3-1567-400a-91f3-600420a0e708] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:52.389402 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f97c7b9c-3341-4246-807f-5fdabecccad2 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:52.390129 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f97c7b9c-3341-4246-807f-5fdabecccad2 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:52.391245 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f97c7b9c-3341-4246-807f-5fdabecccad2 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:52.391920 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f97c7b9c-3341-4246-807f-5fdabecccad2 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:52.524222 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-69e5590c-9ecb-4472-97a3-cd82bbf4d7af tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:52.547578 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-69e5590c-9ecb-4472-97a3-cd82bbf4d7af tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74" status: 200 len: 1522 microversion: 2.1 time: 0.377873 Jun 17 11:42:52.547578 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 109/224] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:52 2022] GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74 => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:52.691326 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f97c7b9c-3341-4246-807f-5fdabecccad2 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:52.700919 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f97c7b9c-3341-4246-807f-5fdabecccad2 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708" status: 200 len: 1314 microversion: 2.1 time: 0.324643 Jun 17 11:42:52.701874 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 116/225] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:52 2022] GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:42:53.172197 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-ef7e1cf3-77d5-4841-93bc-09cc40d016bf req-5e8dd92c-972d-490c-80ae-6db56e81a6d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "071dafa3-1567-400a-91f3-600420a0e708", "tag": "e6e3464a-c697-4275-ac62-a08d8de44196"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:42:53.188016 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-ef7e1cf3-77d5-4841-93bc-09cc40d016bf req-5e8dd92c-972d-490c-80ae-6db56e81a6d8 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:53.188871 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-ef7e1cf3-77d5-4841-93bc-09cc40d016bf req-5e8dd92c-972d-490c-80ae-6db56e81a6d8 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:53.209721 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-ef7e1cf3-77d5-4841-93bc-09cc40d016bf req-5e8dd92c-972d-490c-80ae-6db56e81a6d8 service nova] Creating event network-changed:e6e3464a-c697-4275-ac62-a08d8de44196 for instance 071dafa3-1567-400a-91f3-600420a0e708 on hv-cinder-83716 Jun 17 11:42:53.218323 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-ef7e1cf3-77d5-4841-93bc-09cc40d016bf req-5e8dd92c-972d-490c-80ae-6db56e81a6d8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054114 Jun 17 11:42:53.219470 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 110/226] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:42:53.566121 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-dca2bb64-e0ff-40fa-8cde-94fa47d1e355 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:53.566791 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-dca2bb64-e0ff-40fa-8cde-94fa47d1e355 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:53.568869 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=2 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:42:53.574512 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dca2bb64-e0ff-40fa-8cde-94fa47d1e355 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:53.574960 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dca2bb64-e0ff-40fa-8cde-94fa47d1e355 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:53.575942 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dca2bb64-e0ff-40fa-8cde-94fa47d1e355 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:53.576299 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dca2bb64-e0ff-40fa-8cde-94fa47d1e355 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:53.594652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:42:53.718361 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:42:53.725904 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-244008f5-f71b-4f4f-85be-dbd0b7317805 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:53.726938 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-244008f5-f71b-4f4f-85be-dbd0b7317805 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: 071dafa3-1567-400a-91f3-600420a0e708] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:53.736818 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-244008f5-f71b-4f4f-85be-dbd0b7317805 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:53.737523 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-244008f5-f71b-4f4f-85be-dbd0b7317805 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:53.738787 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-244008f5-f71b-4f4f-85be-dbd0b7317805 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:53.739760 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-244008f5-f71b-4f4f-85be-dbd0b7317805 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:53.767301 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-dca2bb64-e0ff-40fa-8cde-94fa47d1e355 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:53.782697 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-dca2bb64-e0ff-40fa-8cde-94fa47d1e355 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74" status: 200 len: 1522 microversion: 2.1 time: 0.220059 Jun 17 11:42:53.784171 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 117/227] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:53 2022] GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:53.932045 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-244008f5-f71b-4f4f-85be-dbd0b7317805 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:53.932045 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-244008f5-f71b-4f4f-85be-dbd0b7317805 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708" status: 200 len: 1314 microversion: 2.1 time: 0.214018 Jun 17 11:42:53.932045 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 111/228] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:53 2022] GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:54.802471 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1a485ba7-9ef9-4b44-a85f-901bfb0cccaa tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:54.803420 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-1a485ba7-9ef9-4b44-a85f-901bfb0cccaa tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:54.805730 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=8 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:42:54.812788 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1a485ba7-9ef9-4b44-a85f-901bfb0cccaa tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:54.813234 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1a485ba7-9ef9-4b44-a85f-901bfb0cccaa tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:54.814019 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1a485ba7-9ef9-4b44-a85f-901bfb0cccaa tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:54.814453 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1a485ba7-9ef9-4b44-a85f-901bfb0cccaa tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:54.949972 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-73f759d4-b1e4-42aa-af5f-58cc1f501954 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:54.950719 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-73f759d4-b1e4-42aa-af5f-58cc1f501954 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: 071dafa3-1567-400a-91f3-600420a0e708] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:54.957949 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-73f759d4-b1e4-42aa-af5f-58cc1f501954 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:54.958376 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-73f759d4-b1e4-42aa-af5f-58cc1f501954 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:54.959798 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-73f759d4-b1e4-42aa-af5f-58cc1f501954 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:54.960426 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-73f759d4-b1e4-42aa-af5f-58cc1f501954 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:54.983563 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-1a485ba7-9ef9-4b44-a85f-901bfb0cccaa tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:54.993670 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-1a485ba7-9ef9-4b44-a85f-901bfb0cccaa tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74" status: 200 len: 1522 microversion: 2.1 time: 0.194810 Jun 17 11:42:54.995188 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 118/229] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:54 2022] GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:42:55.147606 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-73f759d4-b1e4-42aa-af5f-58cc1f501954 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:55.156458 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-73f759d4-b1e4-42aa-af5f-58cc1f501954 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708" status: 200 len: 1314 microversion: 2.1 time: 0.211790 Jun 17 11:42:55.157079 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 112/230] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:54 2022] GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:56.017309 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-988de1ab-8948-4702-9e89-730ce2318699 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:56.018058 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-988de1ab-8948-4702-9e89-730ce2318699 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:56.025160 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-988de1ab-8948-4702-9e89-730ce2318699 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:56.025702 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-988de1ab-8948-4702-9e89-730ce2318699 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:56.026591 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-988de1ab-8948-4702-9e89-730ce2318699 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:56.027954 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-988de1ab-8948-4702-9e89-730ce2318699 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:56.175115 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-bf96289d-decd-4876-a693-f8f046bcf00e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:56.176152 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-bf96289d-decd-4876-a693-f8f046bcf00e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: 071dafa3-1567-400a-91f3-600420a0e708] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:56.188917 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bf96289d-decd-4876-a693-f8f046bcf00e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:56.189708 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bf96289d-decd-4876-a693-f8f046bcf00e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:56.191129 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bf96289d-decd-4876-a693-f8f046bcf00e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:56.192392 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bf96289d-decd-4876-a693-f8f046bcf00e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:56.383062 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-988de1ab-8948-4702-9e89-730ce2318699 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:56.395678 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-988de1ab-8948-4702-9e89-730ce2318699 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74" status: 200 len: 1522 microversion: 2.1 time: 0.380331 Jun 17 11:42:56.396411 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 119/231] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:56 2022] GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74 => generated 1522 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:56.464482 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-bf96289d-decd-4876-a693-f8f046bcf00e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:56.474214 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-bf96289d-decd-4876-a693-f8f046bcf00e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708" status: 200 len: 1314 microversion: 2.1 time: 0.303410 Jun 17 11:42:56.474815 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 113/232] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:56 2022] GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:42:57.412719 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f1f5b3b3-2f1b-446b-a822-6b44089db193 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:57.413338 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f1f5b3b3-2f1b-446b-a822-6b44089db193 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:57.420733 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f1f5b3b3-2f1b-446b-a822-6b44089db193 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:57.421176 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f1f5b3b3-2f1b-446b-a822-6b44089db193 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:57.421964 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f1f5b3b3-2f1b-446b-a822-6b44089db193 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:57.422399 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f1f5b3b3-2f1b-446b-a822-6b44089db193 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:57.493591 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-5b6e8f1e-5dad-41fa-9288-0f1c5be88ab3 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:57.494259 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-5b6e8f1e-5dad-41fa-9288-0f1c5be88ab3 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: 071dafa3-1567-400a-91f3-600420a0e708] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:57.506436 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5b6e8f1e-5dad-41fa-9288-0f1c5be88ab3 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:57.506436 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5b6e8f1e-5dad-41fa-9288-0f1c5be88ab3 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:57.507480 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5b6e8f1e-5dad-41fa-9288-0f1c5be88ab3 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:57.508612 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5b6e8f1e-5dad-41fa-9288-0f1c5be88ab3 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:57.649543 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f1f5b3b3-2f1b-446b-a822-6b44089db193 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:57.664606 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f1f5b3b3-2f1b-446b-a822-6b44089db193 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74" status: 200 len: 1522 microversion: 2.1 time: 0.255396 Jun 17 11:42:57.665538 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 120/233] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:57 2022] GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:42:57.713220 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5b6e8f1e-5dad-41fa-9288-0f1c5be88ab3 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:57.721364 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-5b6e8f1e-5dad-41fa-9288-0f1c5be88ab3 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708" status: 200 len: 1314 microversion: 2.1 time: 0.232383 Jun 17 11:42:57.721956 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 114/234] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:57 2022] GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:42:58.690074 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-926be7ba-64d0-49e0-b3c7-d69b0418eb68 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:58.690707 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-926be7ba-64d0-49e0-b3c7-d69b0418eb68 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:58.697594 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-926be7ba-64d0-49e0-b3c7-d69b0418eb68 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:58.698037 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-926be7ba-64d0-49e0-b3c7-d69b0418eb68 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:58.698977 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-926be7ba-64d0-49e0-b3c7-d69b0418eb68 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:58.699518 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-926be7ba-64d0-49e0-b3c7-d69b0418eb68 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:58.739100 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-813c0297-6540-4080-9cf9-ec5dda97d6e3 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:58.739901 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-813c0297-6540-4080-9cf9-ec5dda97d6e3 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: 071dafa3-1567-400a-91f3-600420a0e708] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:58.742631 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:42:58.749205 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-813c0297-6540-4080-9cf9-ec5dda97d6e3 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:58.749652 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-813c0297-6540-4080-9cf9-ec5dda97d6e3 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:58.750582 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-813c0297-6540-4080-9cf9-ec5dda97d6e3 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:58.751022 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-813c0297-6540-4080-9cf9-ec5dda97d6e3 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:58.902490 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-926be7ba-64d0-49e0-b3c7-d69b0418eb68 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:58.916616 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-926be7ba-64d0-49e0-b3c7-d69b0418eb68 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74" status: 200 len: 1522 microversion: 2.1 time: 0.230067 Jun 17 11:42:58.927282 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 121/235] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:58 2022] GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:42:58.959795 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-813c0297-6540-4080-9cf9-ec5dda97d6e3 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:42:58.969146 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-813c0297-6540-4080-9cf9-ec5dda97d6e3 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708" status: 200 len: 1314 microversion: 2.1 time: 0.234081 Jun 17 11:42:58.969738 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 115/236] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:58 2022] GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:42:59.936830 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-59333e06-3aff-47b6-af45-3efa10e9f9e6 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:59.939384 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-59333e06-3aff-47b6-af45-3efa10e9f9e6 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:42:59.949620 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-59333e06-3aff-47b6-af45-3efa10e9f9e6 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:59.950576 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-59333e06-3aff-47b6-af45-3efa10e9f9e6 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:59.951938 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-59333e06-3aff-47b6-af45-3efa10e9f9e6 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:42:59.952902 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-59333e06-3aff-47b6-af45-3efa10e9f9e6 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:42:59.992427 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8bbb5a30-d0ef-478c-8a7e-e57dda04c27c tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:42:59.993611 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-8bbb5a30-d0ef-478c-8a7e-e57dda04c27c tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: 071dafa3-1567-400a-91f3-600420a0e708] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:00.015686 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8bbb5a30-d0ef-478c-8a7e-e57dda04c27c tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:00.016223 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8bbb5a30-d0ef-478c-8a7e-e57dda04c27c tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:00.017101 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8bbb5a30-d0ef-478c-8a7e-e57dda04c27c tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:00.017604 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8bbb5a30-d0ef-478c-8a7e-e57dda04c27c tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:00.249814 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-8bbb5a30-d0ef-478c-8a7e-e57dda04c27c tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:00.259956 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-59333e06-3aff-47b6-af45-3efa10e9f9e6 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:00.268770 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-8bbb5a30-d0ef-478c-8a7e-e57dda04c27c tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708" status: 200 len: 1314 microversion: 2.1 time: 0.281233 Jun 17 11:43:00.268770 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 116/237] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:59 2022] GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:00.282179 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-59333e06-3aff-47b6-af45-3efa10e9f9e6 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74" status: 200 len: 1522 microversion: 2.1 time: 0.351398 Jun 17 11:43:00.287477 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 122/238] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:42:59 2022] GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74 => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:01.296833 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2c2842bf-f4d7-4905-af43-900c1b42a2a4 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:01.297496 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2c2842bf-f4d7-4905-af43-900c1b42a2a4 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: 071dafa3-1567-400a-91f3-600420a0e708] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:01.306174 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-29ea1b92-da14-470f-8c2d-260759c38b91 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:01.307053 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-29ea1b92-da14-470f-8c2d-260759c38b91 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:01.312404 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2c2842bf-f4d7-4905-af43-900c1b42a2a4 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:01.312404 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2c2842bf-f4d7-4905-af43-900c1b42a2a4 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:01.314565 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2c2842bf-f4d7-4905-af43-900c1b42a2a4 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:01.314565 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2c2842bf-f4d7-4905-af43-900c1b42a2a4 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:01.320021 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-29ea1b92-da14-470f-8c2d-260759c38b91 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:01.321420 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-29ea1b92-da14-470f-8c2d-260759c38b91 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:01.322497 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-29ea1b92-da14-470f-8c2d-260759c38b91 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:01.323052 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-29ea1b92-da14-470f-8c2d-260759c38b91 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:01.584257 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-29ea1b92-da14-470f-8c2d-260759c38b91 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:01.597761 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2c2842bf-f4d7-4905-af43-900c1b42a2a4 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:01.600286 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-29ea1b92-da14-470f-8c2d-260759c38b91 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74" status: 200 len: 1522 microversion: 2.1 time: 0.301543 Jun 17 11:43:01.601238 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 123/239] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:01 2022] GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74 => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:43:01.618325 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2c2842bf-f4d7-4905-af43-900c1b42a2a4 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708" status: 200 len: 1314 microversion: 2.1 time: 0.330845 Jun 17 11:43:01.620452 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 117/240] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:01 2022] GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:02.625623 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-22575814-e41c-49f0-bff1-6af6397b37da tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:02.635502 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-22575814-e41c-49f0-bff1-6af6397b37da tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:02.638447 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-22575814-e41c-49f0-bff1-6af6397b37da tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:02.639262 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-22575814-e41c-49f0-bff1-6af6397b37da tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:02.640745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-22575814-e41c-49f0-bff1-6af6397b37da tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:02.641499 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-22575814-e41c-49f0-bff1-6af6397b37da tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:02.643225 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4139da94-4ba3-4055-a5d5-21d8054e1c5a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:02.643919 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4139da94-4ba3-4055-a5d5-21d8054e1c5a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: 071dafa3-1567-400a-91f3-600420a0e708] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:02.651171 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4139da94-4ba3-4055-a5d5-21d8054e1c5a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:02.651664 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4139da94-4ba3-4055-a5d5-21d8054e1c5a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:02.653531 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4139da94-4ba3-4055-a5d5-21d8054e1c5a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:02.654115 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4139da94-4ba3-4055-a5d5-21d8054e1c5a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:02.678178 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=100 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:43:02.923083 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-22575814-e41c-49f0-bff1-6af6397b37da tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:02.933036 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-22575814-e41c-49f0-bff1-6af6397b37da tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74" status: 200 len: 1522 microversion: 2.1 time: 0.315177 Jun 17 11:43:02.934815 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 124/241] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:02 2022] GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74 => generated 1522 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:02.936724 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-4139da94-4ba3-4055-a5d5-21d8054e1c5a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:02.952275 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4139da94-4ba3-4055-a5d5-21d8054e1c5a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708" status: 200 len: 1314 microversion: 2.1 time: 0.312495 Jun 17 11:43:02.953314 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 118/242] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:02 2022] GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:43:03.956473 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-bb7edd77-5d0e-4554-a122-a2416db9821e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:03.957049 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-bb7edd77-5d0e-4554-a122-a2416db9821e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:03.965681 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bb7edd77-5d0e-4554-a122-a2416db9821e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:03.966703 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bb7edd77-5d0e-4554-a122-a2416db9821e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:03.967690 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bb7edd77-5d0e-4554-a122-a2416db9821e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:03.968266 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bb7edd77-5d0e-4554-a122-a2416db9821e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:03.971793 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b00a0733-1fbc-4edc-9802-434a5fcc0334 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:03.972755 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b00a0733-1fbc-4edc-9802-434a5fcc0334 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: 071dafa3-1567-400a-91f3-600420a0e708] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:03.980234 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b00a0733-1fbc-4edc-9802-434a5fcc0334 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:03.980694 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b00a0733-1fbc-4edc-9802-434a5fcc0334 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:03.981488 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b00a0733-1fbc-4edc-9802-434a5fcc0334 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:03.981953 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b00a0733-1fbc-4edc-9802-434a5fcc0334 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:04.312522 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-bb7edd77-5d0e-4554-a122-a2416db9821e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:04.317387 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b00a0733-1fbc-4edc-9802-434a5fcc0334 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:04.327839 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b00a0733-1fbc-4edc-9802-434a5fcc0334 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708" status: 200 len: 1314 microversion: 2.1 time: 0.359815 Jun 17 11:43:04.328680 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 119/243] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:03 2022] GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708 => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:43:04.338309 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-bb7edd77-5d0e-4554-a122-a2416db9821e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74" status: 200 len: 1522 microversion: 2.1 time: 0.386047 Jun 17 11:43:04.339483 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 125/244] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:03 2022] GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74 => generated 1522 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:05.124996 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-7de73b75-608c-45a3-8814-d1a644dabf39 req-e267529c-2896-4209-8ec0-770e8e338f29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "071dafa3-1567-400a-91f3-600420a0e708", "name": "network-vif-plugged", "status": "completed", "tag": "e6e3464a-c697-4275-ac62-a08d8de44196"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:43:05.138507 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-7de73b75-608c-45a3-8814-d1a644dabf39 req-e267529c-2896-4209-8ec0-770e8e338f29 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:05.139040 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-7de73b75-608c-45a3-8814-d1a644dabf39 req-e267529c-2896-4209-8ec0-770e8e338f29 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:05.151690 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-7de73b75-608c-45a3-8814-d1a644dabf39 req-e267529c-2896-4209-8ec0-770e8e338f29 service nova] Creating event network-vif-plugged:e6e3464a-c697-4275-ac62-a08d8de44196 for instance 071dafa3-1567-400a-91f3-600420a0e708 on hv-cinder-83716 Jun 17 11:43:05.158177 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-7de73b75-608c-45a3-8814-d1a644dabf39 req-e267529c-2896-4209-8ec0-770e8e338f29 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040602 Jun 17 11:43:05.158804 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 120/245] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:43:05.351207 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-921b4125-9cb6-4094-b1db-752892e9fc19 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:05.352418 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-921b4125-9cb6-4094-b1db-752892e9fc19 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: 071dafa3-1567-400a-91f3-600420a0e708] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:05.360136 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c85d8db4-a9e1-4249-a340-78fc6508a615 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:05.361270 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c85d8db4-a9e1-4249-a340-78fc6508a615 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:05.364361 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-921b4125-9cb6-4094-b1db-752892e9fc19 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:05.365158 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-921b4125-9cb6-4094-b1db-752892e9fc19 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:05.366621 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-921b4125-9cb6-4094-b1db-752892e9fc19 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:05.367534 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-921b4125-9cb6-4094-b1db-752892e9fc19 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:05.368356 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c85d8db4-a9e1-4249-a340-78fc6508a615 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:05.368824 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c85d8db4-a9e1-4249-a340-78fc6508a615 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:05.369626 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c85d8db4-a9e1-4249-a340-78fc6508a615 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:05.370062 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c85d8db4-a9e1-4249-a340-78fc6508a615 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:05.599215 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c85d8db4-a9e1-4249-a340-78fc6508a615 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:05.610487 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c85d8db4-a9e1-4249-a340-78fc6508a615 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74" status: 200 len: 1522 microversion: 2.1 time: 0.256476 Jun 17 11:43:05.616302 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-921b4125-9cb6-4094-b1db-752892e9fc19 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:05.616775 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 121/246] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:05 2022] GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:43:05.631486 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-921b4125-9cb6-4094-b1db-752892e9fc19 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708" status: 200 len: 1314 microversion: 2.1 time: 0.287617 Jun 17 11:43:05.639637 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 126/247] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:05 2022] GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:06.635267 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-cd47b1b7-0c03-46c7-afce-82bddf1b1ec0 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:06.637111 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-cd47b1b7-0c03-46c7-afce-82bddf1b1ec0 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:06.649278 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cd47b1b7-0c03-46c7-afce-82bddf1b1ec0 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:06.650036 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cd47b1b7-0c03-46c7-afce-82bddf1b1ec0 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:06.651489 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cd47b1b7-0c03-46c7-afce-82bddf1b1ec0 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:06.652367 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cd47b1b7-0c03-46c7-afce-82bddf1b1ec0 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:06.660592 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-be86366d-631a-4bb7-ab2e-de96d673b42e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:06.661785 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-be86366d-631a-4bb7-ab2e-de96d673b42e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: 071dafa3-1567-400a-91f3-600420a0e708] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:06.668963 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-be86366d-631a-4bb7-ab2e-de96d673b42e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:06.669425 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-be86366d-631a-4bb7-ab2e-de96d673b42e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:06.670285 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-be86366d-631a-4bb7-ab2e-de96d673b42e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:06.670744 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-be86366d-631a-4bb7-ab2e-de96d673b42e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:06.903876 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-be86366d-631a-4bb7-ab2e-de96d673b42e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:06.911249 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-cd47b1b7-0c03-46c7-afce-82bddf1b1ec0 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:06.918332 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-be86366d-631a-4bb7-ab2e-de96d673b42e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708" status: 200 len: 1314 microversion: 2.1 time: 0.261367 Jun 17 11:43:06.919502 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 127/248] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:06 2022] GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:06.927875 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-cd47b1b7-0c03-46c7-afce-82bddf1b1ec0 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74" status: 200 len: 1522 microversion: 2.1 time: 0.298589 Jun 17 11:43:06.927875 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 122/249] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:06 2022] GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:07.943731 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1751e258-80c1-4b88-b9a2-968338745cd4 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:07.945110 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-1751e258-80c1-4b88-b9a2-968338745cd4 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: 071dafa3-1567-400a-91f3-600420a0e708] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:07.952737 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-5cc50238-7bfd-4622-b789-8300a66900c7 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:07.953412 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1751e258-80c1-4b88-b9a2-968338745cd4 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:07.953650 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1751e258-80c1-4b88-b9a2-968338745cd4 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:07.954099 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-5cc50238-7bfd-4622-b789-8300a66900c7 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:07.954533 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1751e258-80c1-4b88-b9a2-968338745cd4 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:07.954964 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1751e258-80c1-4b88-b9a2-968338745cd4 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:07.966930 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5cc50238-7bfd-4622-b789-8300a66900c7 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:07.967786 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5cc50238-7bfd-4622-b789-8300a66900c7 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:07.969322 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5cc50238-7bfd-4622-b789-8300a66900c7 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:07.970201 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5cc50238-7bfd-4622-b789-8300a66900c7 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:08.171763 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-1751e258-80c1-4b88-b9a2-968338745cd4 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:08.181186 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-1751e258-80c1-4b88-b9a2-968338745cd4 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708" status: 200 len: 1314 microversion: 2.1 time: 0.241858 Jun 17 11:43:08.181795 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 128/250] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:07 2022] GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:08.212978 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5cc50238-7bfd-4622-b789-8300a66900c7 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:08.224363 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-5cc50238-7bfd-4622-b789-8300a66900c7 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74" status: 200 len: 1522 microversion: 2.1 time: 0.278878 Jun 17 11:43:08.225367 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 123/251] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:07 2022] GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:09.198919 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d6a8e005-49db-496a-8654-fbe21ea9ed6e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:09.200490 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d6a8e005-49db-496a-8654-fbe21ea9ed6e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: 071dafa3-1567-400a-91f3-600420a0e708] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:09.202973 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:43:09.209523 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d6a8e005-49db-496a-8654-fbe21ea9ed6e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:09.210107 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d6a8e005-49db-496a-8654-fbe21ea9ed6e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:09.211164 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d6a8e005-49db-496a-8654-fbe21ea9ed6e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:09.211926 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d6a8e005-49db-496a-8654-fbe21ea9ed6e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:09.247919 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-73184b9b-5a69-4986-af65-fe0523d076c0 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:09.250713 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-73184b9b-5a69-4986-af65-fe0523d076c0 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:09.266177 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-73184b9b-5a69-4986-af65-fe0523d076c0 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:09.270597 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-73184b9b-5a69-4986-af65-fe0523d076c0 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:09.270597 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-73184b9b-5a69-4986-af65-fe0523d076c0 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:09.270597 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-73184b9b-5a69-4986-af65-fe0523d076c0 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:09.557411 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d6a8e005-49db-496a-8654-fbe21ea9ed6e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:09.577712 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d6a8e005-49db-496a-8654-fbe21ea9ed6e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708" status: 200 len: 1498 microversion: 2.1 time: 0.382063 Jun 17 11:43:09.580165 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 129/252] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:09 2022] GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708 => generated 1498 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:09.643682 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-73184b9b-5a69-4986-af65-fe0523d076c0 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:09.655494 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-73184b9b-5a69-4986-af65-fe0523d076c0 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74" status: 200 len: 1522 microversion: 2.1 time: 0.415595 Jun 17 11:43:09.656347 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 124/253] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:09 2022] GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74 => generated 1522 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:43:10.607711 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-7caffedd-9088-4af6-a4de-3b7b0de09f00 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:10.608270 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7caffedd-9088-4af6-a4de-3b7b0de09f00 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: 071dafa3-1567-400a-91f3-600420a0e708] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:10.615298 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7caffedd-9088-4af6-a4de-3b7b0de09f00 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:10.615844 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7caffedd-9088-4af6-a4de-3b7b0de09f00 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:10.616609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7caffedd-9088-4af6-a4de-3b7b0de09f00 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:10.617146 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7caffedd-9088-4af6-a4de-3b7b0de09f00 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:10.648497 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7caffedd-9088-4af6-a4de-3b7b0de09f00 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: 071dafa3-1567-400a-91f3-600420a0e708] Going to try to terminate instance {{(pid=124844) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 11:43:10.683088 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-27920f98-7b74-4c18-a539-352f1f8c3041 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:10.684624 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-27920f98-7b74-4c18-a539-352f1f8c3041 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:10.696684 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-27920f98-7b74-4c18-a539-352f1f8c3041 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:10.697593 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-27920f98-7b74-4c18-a539-352f1f8c3041 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:10.699018 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-27920f98-7b74-4c18-a539-352f1f8c3041 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:10.700452 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-27920f98-7b74-4c18-a539-352f1f8c3041 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:10.887944 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-27920f98-7b74-4c18-a539-352f1f8c3041 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:10.897924 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-27920f98-7b74-4c18-a539-352f1f8c3041 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74" status: 200 len: 1522 microversion: 2.1 time: 0.221732 Jun 17 11:43:10.899474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 125/254] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:10 2022] GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:43:10.969329 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-7caffedd-9088-4af6-a4de-3b7b0de09f00 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "DELETE /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708" status: 204 len: 0 microversion: 2.1 time: 0.365937 Jun 17 11:43:10.970020 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 130/255] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 17 11:43:10 2022] DELETE /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 17 11:43:10.979406 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6fb06890-8a11-462b-9593-3cce7a3ce91a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:10.980096 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-6fb06890-8a11-462b-9593-3cce7a3ce91a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: 071dafa3-1567-400a-91f3-600420a0e708] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:10.988558 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6fb06890-8a11-462b-9593-3cce7a3ce91a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:10.989044 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6fb06890-8a11-462b-9593-3cce7a3ce91a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:10.989862 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6fb06890-8a11-462b-9593-3cce7a3ce91a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:10.990329 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6fb06890-8a11-462b-9593-3cce7a3ce91a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:11.181964 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6fb06890-8a11-462b-9593-3cce7a3ce91a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:11.195493 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-6fb06890-8a11-462b-9593-3cce7a3ce91a tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708" status: 200 len: 1504 microversion: 2.1 time: 0.219914 Jun 17 11:43:11.197184 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 126/256] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:10 2022] GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708 => generated 1504 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:11.917143 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5890d3d7-5df6-4239-8375-b7baa4e24645 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:11.919999 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-5890d3d7-5df6-4239-8375-b7baa4e24645 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:11.932237 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5890d3d7-5df6-4239-8375-b7baa4e24645 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:11.932237 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5890d3d7-5df6-4239-8375-b7baa4e24645 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:11.932612 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5890d3d7-5df6-4239-8375-b7baa4e24645 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:11.933208 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5890d3d7-5df6-4239-8375-b7baa4e24645 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:11.934401 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-51520317-11f4-4e08-ad85-c8b93e247d3d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:11.935714 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-51520317-11f4-4e08-ad85-c8b93e247d3d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:11.945336 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-51520317-11f4-4e08-ad85-c8b93e247d3d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:11.945987 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-51520317-11f4-4e08-ad85-c8b93e247d3d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:11.947076 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-51520317-11f4-4e08-ad85-c8b93e247d3d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:11.947681 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-51520317-11f4-4e08-ad85-c8b93e247d3d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:11.979210 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-51520317-11f4-4e08-ad85-c8b93e247d3d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2/ips" status: 200 len: 146 microversion: 2.1 time: 0.050331 Jun 17 11:43:11.979880 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 127/257] 10.222.0.45 () {58 vars in 1247 bytes} [Fri Jun 17 11:43:11 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2/ips => generated 146 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:43:12.116050 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5890d3d7-5df6-4239-8375-b7baa4e24645 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:12.132088 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5890d3d7-5df6-4239-8375-b7baa4e24645 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74" status: 200 len: 1522 microversion: 2.1 time: 0.219779 Jun 17 11:43:12.133601 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 131/258] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:11 2022] GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:12.222448 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-433d0bbf-668f-4eaa-9ec2-00d3005dc1d7 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:12.223492 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-433d0bbf-668f-4eaa-9ec2-00d3005dc1d7 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: 071dafa3-1567-400a-91f3-600420a0e708] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:12.232331 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-433d0bbf-668f-4eaa-9ec2-00d3005dc1d7 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:12.233039 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-433d0bbf-668f-4eaa-9ec2-00d3005dc1d7 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:12.233999 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-433d0bbf-668f-4eaa-9ec2-00d3005dc1d7 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:12.234519 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-433d0bbf-668f-4eaa-9ec2-00d3005dc1d7 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:12.454329 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-433d0bbf-668f-4eaa-9ec2-00d3005dc1d7 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:12.465329 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-433d0bbf-668f-4eaa-9ec2-00d3005dc1d7 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708" status: 200 len: 1504 microversion: 2.1 time: 0.246385 Jun 17 11:43:12.466759 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 128/259] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:12 2022] GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708 => generated 1504 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:13.153930 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-95a8686a-91ed-4f0c-83bf-edd66469d005 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:13.154919 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-95a8686a-91ed-4f0c-83bf-edd66469d005 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:13.161265 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-95a8686a-91ed-4f0c-83bf-edd66469d005 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:13.161602 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-95a8686a-91ed-4f0c-83bf-edd66469d005 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:13.162376 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-95a8686a-91ed-4f0c-83bf-edd66469d005 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:13.162831 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-95a8686a-91ed-4f0c-83bf-edd66469d005 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:13.183220 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:43:13.369759 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-95a8686a-91ed-4f0c-83bf-edd66469d005 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:13.378273 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-95a8686a-91ed-4f0c-83bf-edd66469d005 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74" status: 200 len: 1502 microversion: 2.1 time: 0.228579 Jun 17 11:43:13.378880 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 132/260] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:13 2022] GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74 => generated 1502 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:13.403584 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-eb3d5b5b-f7fd-481e-bf1e-f7ce4bd4be50 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d2c846bf-64eb-4c14-81cf-88c0061e0fe2"}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:43:13.405516 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-eb3d5b5b-f7fd-481e-bf1e-f7ce4bd4be50 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:13.416793 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-eb3d5b5b-f7fd-481e-bf1e-f7ce4bd4be50 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:13.417397 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-eb3d5b5b-f7fd-481e-bf1e-f7ce4bd4be50 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:13.419748 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-eb3d5b5b-f7fd-481e-bf1e-f7ce4bd4be50 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:13.420226 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-eb3d5b5b-f7fd-481e-bf1e-f7ce4bd4be50 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:13.448117 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-eb3d5b5b-f7fd-481e-bf1e-f7ce4bd4be50 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] HTTP exception thrown: Cannot 'attach_volume' instance 39a1319f-9f84-46db-9981-30ff7e4acc74 while it is in vm_state rescued Jun 17 11:43:13.450983 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-eb3d5b5b-f7fd-481e-bf1e-f7ce4bd4be50 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Request method failure captured: Jun 17 11:43:13.450983 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: request: POST /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74/os-volume_attachments HTTP/1.1 Jun 17 11:43:13.450983 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jun 17 11:43:13.450983 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jun 17 11:43:13.450983 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Connection: close Jun 17 11:43:13.450983 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Length: 74 Jun 17 11:43:13.450983 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jun 17 11:43:13.450983 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.45 Jun 17 11:43:13.450983 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jun 17 11:43:13.450983 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jun 17 11:43:13.450983 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABirGhYXPEneGbWlDHr4IdGyKcI2lSvyu7_ndCScBUrORne39u-qQqZEMZQFH6SJDovDOcnVKjNuoxzr715SnSXgShkw-ZY_5pruDdyzsw0BrOMIBFmyx6bizWQou_OUbd6ovLhc1PtNOl8-D1aQsyvMYXlGV0IY28idRqZ__sES5ASbXg Jun 17 11:43:13.450983 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jun 17 11:43:13.450983 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jun 17 11:43:13.450983 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jun 17 11:43:13.450983 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jun 17 11:43:13.450983 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jun 17 11:43:13.450983 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jun 17 11:43:13.450983 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Id: e38262ed2ed84004a6e01d423cadcae4 Jun 17 11:43:13.450983 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1413190309 Jun 17 11:43:13.450983 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jun 17 11:43:13.450983 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jun 17 11:43:13.452460 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e38262ed2ed84004a6e01d423cadcae4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e38262ed2ed84004a6e01d423cadcae4", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e38262ed2ed84004a6e01d423cadcae4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e38262ed2ed84004a6e01d423cadcae4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:43:13.452460 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1413190309 Jun 17 11:43:13.452460 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: e38262ed2ed84004a6e01d423cadcae4 Jun 17 11:43:13.452460 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1413190309 Jun 17 11:43:13.452460 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User: tempest-ServerRescueNegativeTestJSON-1413190309-project Jun 17 11:43:13.452460 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jun 17 11:43:13.452460 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jun 17 11:43:13.452460 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Id: a79957b3f2e94f31bd2cb82290ed0962 Jun 17 11:43:13.452460 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1413190309-project Jun 17 11:43:13.452460 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Jun 17 11:43:13.452460 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: {"volumeAttachment": {"volumeId": "d2c846bf-64eb-4c14-81cf-88c0061e0fe2"}} Jun 17 11:43:13.452460 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: method: > Jun 17 11:43:13.453419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: exception: Cannot 'attach_volume' instance 39a1319f-9f84-46db-9981-30ff7e4acc74 while it is in vm_state rescued Jun 17 11:43:13.453419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: action_args: {'server_id': '39a1319f-9f84-46db-9981-30ff7e4acc74', 'body': {'volumeAttachment': {'volumeId': 'd2c846bf-64eb-4c14-81cf-88c0061e0fe2'}}} Jun 17 11:43:13.453419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:43:13.453419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:43:13.453419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 17 11:43:13.453419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 17 11:43:13.453419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 11:43:13.453419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 11:43:13.453419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 17 11:43:13.453419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 17 11:43:13.453419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 39a1319f-9f84-46db-9981-30ff7e4acc74 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 17 11:43:13.453419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:43:13.453419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:43:13.453419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:43:13.453419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:43:13.453419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:43:13.453419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:43:13.453419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:43:13.453419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:43:13.454823 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:43:13.454823 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:43:13.454823 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 11:43:13.454823 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 11:43:13.454823 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 11:43:13.454823 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 11:43:13.454823 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 11:43:13.454823 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 11:43:13.454823 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 17 11:43:13.454823 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 17 11:43:13.454823 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 17 11:43:13.454823 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 17 11:43:13.454823 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 39a1319f-9f84-46db-9981-30ff7e4acc74 while it is in vm_state rescued Jun 17 11:43:13.454823 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:43:13.454823 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:43:13.454823 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:43:13.454823 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:43:13.454823 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:43:13.454823 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:43:13.456985 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:43:13.456985 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:43:13.456985 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 39a1319f-9f84-46db-9981-30ff7e4acc74 while it is in vm_state rescued Jun 17 11:43:13.456985 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:43:13.456985 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-eb3d5b5b-f7fd-481e-bf1e-f7ce4bd4be50 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Returning 409 to user: Cannot 'attach_volume' instance 39a1319f-9f84-46db-9981-30ff7e4acc74 while it is in vm_state rescued {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:43:13.456985 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-eb3d5b5b-f7fd-481e-bf1e-f7ce4bd4be50 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "POST /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.057443 Jun 17 11:43:13.456985 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 129/261] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jun 17 11:43:13 2022] POST /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74/os-volume_attachments => generated 152 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 17 11:43:13.463190 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a760a397-b131-4dd6-b9aa-f571340bd2be tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:43:13.463790 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a760a397-b131-4dd6-b9aa-f571340bd2be tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:13.473383 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a760a397-b131-4dd6-b9aa-f571340bd2be tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:13.473849 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a760a397-b131-4dd6-b9aa-f571340bd2be tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:13.475253 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a760a397-b131-4dd6-b9aa-f571340bd2be tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:13.475850 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a760a397-b131-4dd6-b9aa-f571340bd2be tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:13.488107 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8a9a256d-4887-4c35-b6da-a388acf9471e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:13.488107 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-8a9a256d-4887-4c35-b6da-a388acf9471e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: 071dafa3-1567-400a-91f3-600420a0e708] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:13.492738 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8a9a256d-4887-4c35-b6da-a388acf9471e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:13.493146 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8a9a256d-4887-4c35-b6da-a388acf9471e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:13.493983 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8a9a256d-4887-4c35-b6da-a388acf9471e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:13.494426 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8a9a256d-4887-4c35-b6da-a388acf9471e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:13.813728 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-8a9a256d-4887-4c35-b6da-a388acf9471e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:13.821101 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a760a397-b131-4dd6-b9aa-f571340bd2be tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "POST /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74/action" status: 202 len: 0 microversion: 2.1 time: 0.361832 Jun 17 11:43:13.823506 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 133/262] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jun 17 11:43:13 2022] POST /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 11:43:13.830752 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-8a9a256d-4887-4c35-b6da-a388acf9471e tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708" status: 200 len: 1504 microversion: 2.1 time: 0.350897 Jun 17 11:43:13.834304 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 130/263] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:13 2022] GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708 => generated 1504 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:43:13.841386 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b6dd9a72-0a74-4880-aa5b-1a357c5ad607 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:13.841386 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b6dd9a72-0a74-4880-aa5b-1a357c5ad607 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:13.852217 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b6dd9a72-0a74-4880-aa5b-1a357c5ad607 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:13.854303 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b6dd9a72-0a74-4880-aa5b-1a357c5ad607 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:13.857181 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b6dd9a72-0a74-4880-aa5b-1a357c5ad607 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:13.858012 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b6dd9a72-0a74-4880-aa5b-1a357c5ad607 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:14.201140 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b6dd9a72-0a74-4880-aa5b-1a357c5ad607 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:14.215546 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b6dd9a72-0a74-4880-aa5b-1a357c5ad607 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74" status: 200 len: 1510 microversion: 2.1 time: 0.386249 Jun 17 11:43:14.219420 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 134/264] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:13 2022] GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74 => generated 1510 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:14.693439 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-96168f3a-5c9f-4923-bd7e-97819124038d req-a822146c-ee1e-43fd-be72-56c865a33af3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "071dafa3-1567-400a-91f3-600420a0e708", "name": "network-vif-deleted", "tag": "e6e3464a-c697-4275-ac62-a08d8de44196"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:43:14.716330 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-96168f3a-5c9f-4923-bd7e-97819124038d req-a822146c-ee1e-43fd-be72-56c865a33af3 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:14.717628 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-96168f3a-5c9f-4923-bd7e-97819124038d req-a822146c-ee1e-43fd-be72-56c865a33af3 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:14.732896 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-96168f3a-5c9f-4923-bd7e-97819124038d req-a822146c-ee1e-43fd-be72-56c865a33af3 service nova] Creating event network-vif-deleted:e6e3464a-c697-4275-ac62-a08d8de44196 for instance 071dafa3-1567-400a-91f3-600420a0e708 on hv-cinder-83716 Jun 17 11:43:14.738594 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-96168f3a-5c9f-4923-bd7e-97819124038d req-a822146c-ee1e-43fd-be72-56c865a33af3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054714 Jun 17 11:43:14.739218 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 131/265] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:43:14.865365 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-cacab651-7cb1-4f60-8111-bee2f2b5f1a0 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:14.866088 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-cacab651-7cb1-4f60-8111-bee2f2b5f1a0 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: 071dafa3-1567-400a-91f3-600420a0e708] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:14.872827 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cacab651-7cb1-4f60-8111-bee2f2b5f1a0 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:14.873286 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cacab651-7cb1-4f60-8111-bee2f2b5f1a0 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:14.874070 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cacab651-7cb1-4f60-8111-bee2f2b5f1a0 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:14.874467 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cacab651-7cb1-4f60-8111-bee2f2b5f1a0 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:14.943026 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-cacab651-7cb1-4f60-8111-bee2f2b5f1a0 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:14.951758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-cacab651-7cb1-4f60-8111-bee2f2b5f1a0 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708" status: 200 len: 1462 microversion: 2.1 time: 0.090991 Jun 17 11:43:14.957395 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 135/266] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:14 2022] GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708 => generated 1462 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:15.243296 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-7dbd28bc-b5d5-4fde-9494-86efa4dbc38b tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:15.244133 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-7dbd28bc-b5d5-4fde-9494-86efa4dbc38b tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:15.254527 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7dbd28bc-b5d5-4fde-9494-86efa4dbc38b tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:15.255295 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7dbd28bc-b5d5-4fde-9494-86efa4dbc38b tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:15.256874 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7dbd28bc-b5d5-4fde-9494-86efa4dbc38b tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:15.257691 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7dbd28bc-b5d5-4fde-9494-86efa4dbc38b tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:15.457455 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-7dbd28bc-b5d5-4fde-9494-86efa4dbc38b tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:15.468894 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-7dbd28bc-b5d5-4fde-9494-86efa4dbc38b tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74" status: 200 len: 1510 microversion: 2.1 time: 0.229850 Jun 17 11:43:15.475447 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 132/267] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:15 2022] GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74 => generated 1510 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:15.970073 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-842c5a65-c404-473c-8281-ffe21ff110eb tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:15.970801 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-842c5a65-c404-473c-8281-ffe21ff110eb tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: 071dafa3-1567-400a-91f3-600420a0e708] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:15.977190 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-842c5a65-c404-473c-8281-ffe21ff110eb tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:15.977793 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-842c5a65-c404-473c-8281-ffe21ff110eb tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:15.988044 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-842c5a65-c404-473c-8281-ffe21ff110eb tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:15.988044 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-842c5a65-c404-473c-8281-ffe21ff110eb tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:16.013368 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-842c5a65-c404-473c-8281-ffe21ff110eb tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:16.013822 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-842c5a65-c404-473c-8281-ffe21ff110eb tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:16.014276 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-842c5a65-c404-473c-8281-ffe21ff110eb tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lazy-loading 'fault' on Instance uuid 071dafa3-1567-400a-91f3-600420a0e708 {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:43:16.060055 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-842c5a65-c404-473c-8281-ffe21ff110eb tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:16.068425 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-842c5a65-c404-473c-8281-ffe21ff110eb tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708" status: 200 len: 1304 microversion: 2.1 time: 0.103310 Jun 17 11:43:16.069397 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 136/268] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:15 2022] GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708 => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:16.330220 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-57140e48-f180-46a0-82e3-81810133b00e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:16.330784 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-57140e48-f180-46a0-82e3-81810133b00e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: be48aa4e-115e-4d58-8940-f722120f4664] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:16.342702 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-57140e48-f180-46a0-82e3-81810133b00e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:16.342702 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-57140e48-f180-46a0-82e3-81810133b00e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:16.342702 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-57140e48-f180-46a0-82e3-81810133b00e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:16.342702 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-57140e48-f180-46a0-82e3-81810133b00e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:16.375620 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-57140e48-f180-46a0-82e3-81810133b00e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664/ips" status: 200 len: 147 microversion: 2.1 time: 0.050719 Jun 17 11:43:16.376686 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 133/269] 10.222.0.45 () {58 vars in 1247 bytes} [Fri Jun 17 11:43:16 2022] GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664/ips => generated 147 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:43:16.500346 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3a0528bf-cf7e-47d6-abf4-5742b87dd83a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:16.501449 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-3a0528bf-cf7e-47d6-abf4-5742b87dd83a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:16.519996 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3a0528bf-cf7e-47d6-abf4-5742b87dd83a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:16.521089 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3a0528bf-cf7e-47d6-abf4-5742b87dd83a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:16.522722 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3a0528bf-cf7e-47d6-abf4-5742b87dd83a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:16.523899 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3a0528bf-cf7e-47d6-abf4-5742b87dd83a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:16.800847 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3a0528bf-cf7e-47d6-abf4-5742b87dd83a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:16.813177 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-3a0528bf-cf7e-47d6-abf4-5742b87dd83a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74" status: 200 len: 1510 microversion: 2.1 time: 0.321586 Jun 17 11:43:16.816010 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 137/270] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:16 2022] GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74 => generated 1510 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:16.819911 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f327e584-de7c-4c68-904c-d751355c3c0a tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8dfbbf1c-e387-4897-9008-2defe1da3e10"}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:43:16.822572 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f327e584-de7c-4c68-904c-d751355c3c0a tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:16.835833 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f327e584-de7c-4c68-904c-d751355c3c0a tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:16.836685 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f327e584-de7c-4c68-904c-d751355c3c0a tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:16.838375 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f327e584-de7c-4c68-904c-d751355c3c0a tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:16.839128 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f327e584-de7c-4c68-904c-d751355c3c0a tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:17.091750 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-82b2f68e-7b30-48ed-8bc0-6487e7321ca8 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:17.096151 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-82b2f68e-7b30-48ed-8bc0-6487e7321ca8 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: 071dafa3-1567-400a-91f3-600420a0e708] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:17.100340 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-82b2f68e-7b30-48ed-8bc0-6487e7321ca8 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:17.102286 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-82b2f68e-7b30-48ed-8bc0-6487e7321ca8 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:17.104663 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-82b2f68e-7b30-48ed-8bc0-6487e7321ca8 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:17.105282 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-82b2f68e-7b30-48ed-8bc0-6487e7321ca8 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:17.140551 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-82b2f68e-7b30-48ed-8bc0-6487e7321ca8 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:17.141010 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-82b2f68e-7b30-48ed-8bc0-6487e7321ca8 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:17.141467 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-82b2f68e-7b30-48ed-8bc0-6487e7321ca8 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lazy-loading 'fault' on Instance uuid 071dafa3-1567-400a-91f3-600420a0e708 {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:43:17.217745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-82b2f68e-7b30-48ed-8bc0-6487e7321ca8 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6039f599d44024ac3fdd6cbb65e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c1e0064ef5486795031aff48250978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:17.226148 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-82b2f68e-7b30-48ed-8bc0-6487e7321ca8 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708" status: 200 len: 1304 microversion: 2.1 time: 0.143736 Jun 17 11:43:17.228038 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 138/271] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:17 2022] GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708 => generated 1304 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:43:17.833698 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-28b70db2-f5bc-44cb-8462-e791286a2aed tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:17.834311 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-28b70db2-f5bc-44cb-8462-e791286a2aed tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:17.844284 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-28b70db2-f5bc-44cb-8462-e791286a2aed tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:17.844811 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-28b70db2-f5bc-44cb-8462-e791286a2aed tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:17.845654 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-28b70db2-f5bc-44cb-8462-e791286a2aed tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:17.846484 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-28b70db2-f5bc-44cb-8462-e791286a2aed tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:18.001433 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-28b70db2-f5bc-44cb-8462-e791286a2aed tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:18.044847 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-28b70db2-f5bc-44cb-8462-e791286a2aed tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74" status: 200 len: 1516 microversion: 2.1 time: 0.179839 Jun 17 11:43:18.044847 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 139/272] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:17 2022] GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74 => generated 1516 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:43:18.248478 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4563487b-e1eb-42cd-9fb2-cfd9116f01b3 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:18.249614 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4563487b-e1eb-42cd-9fb2-cfd9116f01b3 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] [instance: 071dafa3-1567-400a-91f3-600420a0e708] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:18.256504 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4563487b-e1eb-42cd-9fb2-cfd9116f01b3 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:18.256957 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4563487b-e1eb-42cd-9fb2-cfd9116f01b3 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:18.257748 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4563487b-e1eb-42cd-9fb2-cfd9116f01b3 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:18.258183 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4563487b-e1eb-42cd-9fb2-cfd9116f01b3 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:18.278773 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-4563487b-e1eb-42cd-9fb2-cfd9116f01b3 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] HTTP exception thrown: Instance 071dafa3-1567-400a-91f3-600420a0e708 could not be found. Jun 17 11:43:18.278773 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4563487b-e1eb-42cd-9fb2-cfd9116f01b3 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Request method failure captured: Jun 17 11:43:18.278773 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: request: GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708 HTTP/1.1 Jun 17 11:43:18.278773 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept: application/json Jun 17 11:43:18.278773 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jun 17 11:43:18.278773 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Connection: close Jun 17 11:43:18.278773 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jun 17 11:43:18.278773 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jun 17 11:43:18.278773 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Host: 10.222.0.45 Jun 17 11:43:18.278773 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jun 17 11:43:18.278773 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jun 17 11:43:18.278773 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABirGiKy1QsHKBuFdJnSODOSOGzT8bbjShv7IIMB-edyBDwOk4fK3Y69h5XhIK1PQ5Is6BujRjzqesLOPnSMG8LxCOuRSxjf-kj4vJtUkFjRNqi2IhLLozUsOt9okpSX9Zy4JdhV8SchfGDvypI_Y-hfDzhzS8dbnu9NRM1_OZQ-6dJrJw Jun 17 11:43:18.278773 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jun 17 11:43:18.278773 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jun 17 11:43:18.278773 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jun 17 11:43:18.278773 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jun 17 11:43:18.278773 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jun 17 11:43:18.278773 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jun 17 11:43:18.278773 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Id: b1c1e0064ef5486795031aff48250978 Jun 17 11:43:18.278773 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-VolumesActionsTest-1960376485 Jun 17 11:43:18.278773 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Role: member,reader Jun 17 11:43:18.278773 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Roles: member,reader Jun 17 11:43:18.280940 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b1c1e0064ef5486795031aff48250978"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b1c1e0064ef5486795031aff48250978", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b1c1e0064ef5486795031aff48250978"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b1c1e0064ef5486795031aff48250978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:43:18.280940 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-VolumesActionsTest-1960376485 Jun 17 11:43:18.280940 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Id: b1c1e0064ef5486795031aff48250978 Jun 17 11:43:18.280940 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-VolumesActionsTest-1960376485 Jun 17 11:43:18.280940 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User: tempest-VolumesActionsTest-1960376485-project Jun 17 11:43:18.280940 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jun 17 11:43:18.280940 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jun 17 11:43:18.280940 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Id: ee6039f599d44024ac3fdd6cbb65e62f Jun 17 11:43:18.280940 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-VolumesActionsTest-1960376485-project Jun 17 11:43:18.280940 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: method: > Jun 17 11:43:18.280940 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: exception: Instance 071dafa3-1567-400a-91f3-600420a0e708 could not be found. Jun 17 11:43:18.280940 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: action_args: {'id': '071dafa3-1567-400a-91f3-600420a0e708'} Jun 17 11:43:18.281598 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:43:18.281598 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:43:18.281598 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:43:18.281598 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:43:18.281598 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:43:18.281598 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:43:18.281598 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:43:18.281598 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:43:18.281598 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:43:18.281598 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:43:18.281598 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 071dafa3-1567-400a-91f3-600420a0e708 could not be found. Jun 17 11:43:18.281598 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:43:18.281598 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:43:18.281598 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:43:18.281598 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:43:18.281598 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:43:18.281598 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:43:18.281598 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:43:18.281598 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:43:18.281598 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:43:18.282678 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:43:18.282678 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 11:43:18.282678 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 11:43:18.282678 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:43:18.282678 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:43:18.282678 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:43:18.282678 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:43:18.282678 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 071dafa3-1567-400a-91f3-600420a0e708 could not be found. Jun 17 11:43:18.282678 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:43:18.282678 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:43:18.282678 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:43:18.282678 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:43:18.282678 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:43:18.282678 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:43:18.282678 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:43:18.282678 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:43:18.282678 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 071dafa3-1567-400a-91f3-600420a0e708 could not be found. Jun 17 11:43:18.282678 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:43:18.283737 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4563487b-e1eb-42cd-9fb2-cfd9116f01b3 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] Returning 404 to user: Instance 071dafa3-1567-400a-91f3-600420a0e708 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:43:18.283737 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4563487b-e1eb-42cd-9fb2-cfd9116f01b3 tempest-VolumesActionsTest-1960376485 tempest-VolumesActionsTest-1960376485-project] 10.222.0.45 "GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708" status: 404 len: 111 microversion: 2.1 time: 0.035150 Jun 17 11:43:18.283737 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 140/273] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:18 2022] GET /compute/v2.1/servers/071dafa3-1567-400a-91f3-600420a0e708 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 11:43:18.893940 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-79f51889-eb4f-48b6-a1c1-79b660378f28 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41bb0945-b2db-47bd-aaa1-dc0fdab9c83e"}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:43:18.895005 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-79f51889-eb4f-48b6-a1c1-79b660378f28 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: be48aa4e-115e-4d58-8940-f722120f4664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:18.901762 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-79f51889-eb4f-48b6-a1c1-79b660378f28 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:18.902202 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-79f51889-eb4f-48b6-a1c1-79b660378f28 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:18.904598 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-79f51889-eb4f-48b6-a1c1-79b660378f28 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:18.905107 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-79f51889-eb4f-48b6-a1c1-79b660378f28 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:18.951313 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f327e584-de7c-4c68-904c-d751355c3c0a tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "POST /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.142545 Jun 17 11:43:18.952409 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 134/274] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jun 17 11:43:16 2022] POST /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2/os-volume_attachments => generated 194 bytes in 2146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:43:19.258743 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-251e6ec8-b7b0-43f4-9876-a112132a4280 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:19.259848 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-251e6ec8-b7b0-43f4-9876-a112132a4280 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:19.274823 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-251e6ec8-b7b0-43f4-9876-a112132a4280 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:19.275585 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-251e6ec8-b7b0-43f4-9876-a112132a4280 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:19.277018 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-251e6ec8-b7b0-43f4-9876-a112132a4280 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:19.278301 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-251e6ec8-b7b0-43f4-9876-a112132a4280 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:19.339876 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-251e6ec8-b7b0-43f4-9876-a112132a4280 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972/ips" status: 200 len: 151 microversion: 2.20 time: 0.086868 Jun 17 11:43:19.341583 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 135/275] 10.222.0.45 () {60 vars in 1288 bytes} [Fri Jun 17 11:43:19 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972/ips => generated 151 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 11:43:20.355148 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-900ba27d-cbdd-494a-9cf2-237460fa2b0a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Action: 'create', calling method: .version_select at 0x7f9c76a85790>, body: {"keypair": {"name": "tempest-keypair-1615188127", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJaIqVjd3mGrNhKOFN1TUhCihe8j6g0dOl1XUG8to0pWGWqpzfL8IShl8seHyK3ZYwD+DFUNMdeVYQCc6Vv3udhIefKQsbCx9N6f+d/UHW2kGfsfg1Wfi0SwTosB4m7syQ=="}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:43:20.375865 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-900ba27d-cbdd-494a-9cf2-237460fa2b0a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Getting quotas for project e38262ed2ed84004a6e01d423cadcae4. Resources: {'key_pairs'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 11:43:20.380676 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-900ba27d-cbdd-494a-9cf2-237460fa2b0a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Getting quotas for user a79957b3f2e94f31bd2cb82290ed0962 and project e38262ed2ed84004a6e01d423cadcae4. Resources: {'key_pairs'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 11:43:20.497717 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-900ba27d-cbdd-494a-9cf2-237460fa2b0a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.152385 Jun 17 11:43:20.498893 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 136/276] 10.222.0.45 () {60 vars in 1158 bytes} [Fri Jun 17 11:43:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:43:21.134509 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-79f51889-eb4f-48b6-a1c1-79b660378f28 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "POST /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.244471 Jun 17 11:43:21.135259 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 141/277] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jun 17 11:43:18 2022] POST /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664/os-volume_attachments => generated 194 bytes in 2246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:43:22.134978 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-cb12bc4a-863e-4cfd-a68c-35384f570c39 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:43:22.134978 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-cb12bc4a-863e-4cfd-a68c-35384f570c39 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:22.137502 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cb12bc4a-863e-4cfd-a68c-35384f570c39 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:22.138198 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cb12bc4a-863e-4cfd-a68c-35384f570c39 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:22.139356 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cb12bc4a-863e-4cfd-a68c-35384f570c39 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:22.140011 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cb12bc4a-863e-4cfd-a68c-35384f570c39 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:22.169296 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:43:22.180998 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-cb12bc4a-863e-4cfd-a68c-35384f570c39 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lazy-loading 'flavor' on Instance uuid 71050501-8f84-4701-a013-bfc7a4459972 {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:43:23.078028 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-cb12bc4a-863e-4cfd-a68c-35384f570c39 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "POST /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972/action" status: 202 len: 0 microversion: 2.20 time: 0.957461 Jun 17 11:43:23.085003 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 137/278] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jun 17 11:43:22 2022] POST /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972/action => generated 0 bytes in 961 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 17 11:43:23.106918 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-07b55ddc-0a23-48ad-b6c5-efb9a0224129 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:23.109821 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-07b55ddc-0a23-48ad-b6c5-efb9a0224129 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:23.118300 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-07b55ddc-0a23-48ad-b6c5-efb9a0224129 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:23.118746 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-07b55ddc-0a23-48ad-b6c5-efb9a0224129 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:23.119758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-07b55ddc-0a23-48ad-b6c5-efb9a0224129 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:23.120188 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-07b55ddc-0a23-48ad-b6c5-efb9a0224129 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:23.279653 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-07b55ddc-0a23-48ad-b6c5-efb9a0224129 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:23.288047 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-07b55ddc-0a23-48ad-b6c5-efb9a0224129 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:23.289569 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-07b55ddc-0a23-48ad-b6c5-efb9a0224129 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:23.296267 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-07b55ddc-0a23-48ad-b6c5-efb9a0224129 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1723 microversion: 2.20 time: 0.202883 Jun 17 11:43:23.296267 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 142/279] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:43:23 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:43:23.982965 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0f9d1248-ce90-4169-8583-ad5e49c6ad62 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-248355572", "imageRef": "272eb2b7-ddf0-433f-8be8-cdc13c01be77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e4c276b9-0ec2-4a2e-bb49-d12a5faa15dc"}], "security_groups": [{"name": "tempest-securitygroup--519084198"}], "key_name": "tempest-keypair-1615188127", "user_data": "}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:43:24.108226 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.network.neutron [None req-0f9d1248-ce90-4169-8583-ad5e49c6ad62 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] validate_networks() for [('e4c276b9-0ec2-4a2e-bb49-d12a5faa15dc', None, None, None, None, None)] {{(pid=124845) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 11:43:24.311320 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-87719955-e286-4b58-831b-5eacc26f233b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:24.312149 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-87719955-e286-4b58-831b-5eacc26f233b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:24.319166 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-87719955-e286-4b58-831b-5eacc26f233b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:24.319712 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-87719955-e286-4b58-831b-5eacc26f233b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:24.320552 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-87719955-e286-4b58-831b-5eacc26f233b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:24.320995 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-87719955-e286-4b58-831b-5eacc26f233b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:24.547506 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-87719955-e286-4b58-831b-5eacc26f233b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:24.561833 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-87719955-e286-4b58-831b-5eacc26f233b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:24.561833 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-87719955-e286-4b58-831b-5eacc26f233b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:24.561833 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-87719955-e286-4b58-831b-5eacc26f233b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1723 microversion: 2.20 time: 0.253208 Jun 17 11:43:24.562185 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 143/280] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:43:24 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:43:24.643288 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-0f9d1248-ce90-4169-8583-ad5e49c6ad62 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Flavor limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 11:43:24.643771 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-0f9d1248-ce90-4169-8583-ad5e49c6ad62 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Image limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 11:43:24.644280 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-0f9d1248-ce90-4169-8583-ad5e49c6ad62 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Flavor pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 11:43:24.644695 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-0f9d1248-ce90-4169-8583-ad5e49c6ad62 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Image pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 11:43:24.645107 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-0f9d1248-ce90-4169-8583-ad5e49c6ad62 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 11:43:24.654337 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0f9d1248-ce90-4169-8583-ad5e49c6ad62 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:24.654790 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0f9d1248-ce90-4169-8583-ad5e49c6ad62 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:24.655661 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0f9d1248-ce90-4169-8583-ad5e49c6ad62 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:24.656099 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0f9d1248-ce90-4169-8583-ad5e49c6ad62 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:24.673556 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-0f9d1248-ce90-4169-8583-ad5e49c6ad62 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Getting quotas for project e38262ed2ed84004a6e01d423cadcae4. Resources: {'instances', 'ram', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 11:43:24.677680 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-0f9d1248-ce90-4169-8583-ad5e49c6ad62 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Getting quotas for user a79957b3f2e94f31bd2cb82290ed0962 and project e38262ed2ed84004a6e01d423cadcae4. Resources: {'instances', 'ram', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 11:43:24.689722 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0f9d1248-ce90-4169-8583-ad5e49c6ad62 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Going to run 1 instances... {{(pid=124845) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 11:43:24.692287 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0f9d1248-ce90-4169-8583-ad5e49c6ad62 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='272eb2b7-ddf0-433f-8be8-cdc13c01be77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 11:43:24.825984 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0f9d1248-ce90-4169-8583-ad5e49c6ad62 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.848450 Jun 17 11:43:24.827218 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 138/281] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 17 11:43:23 2022] POST /compute/v2.1/servers => generated 408 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 11:43:24.839608 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-89db69cb-5bba-4687-9d73-508c1af96f52 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:24.840543 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-89db69cb-5bba-4687-9d73-508c1af96f52 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:24.915104 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-89db69cb-5bba-4687-9d73-508c1af96f52 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:24.928733 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-89db69cb-5bba-4687-9d73-508c1af96f52 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1245 microversion: 2.1 time: 0.093992 Jun 17 11:43:24.929819 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 144/282] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:24 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1245 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:43:25.584140 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-eac17bac-f3fa-4927-8f49-75e1607b0dbe tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:25.596356 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-eac17bac-f3fa-4927-8f49-75e1607b0dbe tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:25.629475 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-eac17bac-f3fa-4927-8f49-75e1607b0dbe tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:25.630602 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-eac17bac-f3fa-4927-8f49-75e1607b0dbe tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:25.631539 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-eac17bac-f3fa-4927-8f49-75e1607b0dbe tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:25.640203 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-eac17bac-f3fa-4927-8f49-75e1607b0dbe tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:25.819635 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-eac17bac-f3fa-4927-8f49-75e1607b0dbe tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:25.845103 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-eac17bac-f3fa-4927-8f49-75e1607b0dbe tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:25.847992 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-eac17bac-f3fa-4927-8f49-75e1607b0dbe tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:25.849882 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-eac17bac-f3fa-4927-8f49-75e1607b0dbe tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1723 microversion: 2.20 time: 0.272566 Jun 17 11:43:25.850948 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 139/283] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:43:25 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1723 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:43:25.958276 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-eafb3e7d-f2cd-462b-80a5-625c8a38a669 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:25.959635 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-eafb3e7d-f2cd-462b-80a5-625c8a38a669 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:26.035063 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-eafb3e7d-f2cd-462b-80a5-625c8a38a669 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:26.044158 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-eafb3e7d-f2cd-462b-80a5-625c8a38a669 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1245 microversion: 2.1 time: 0.092252 Jun 17 11:43:26.045035 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 145/284] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:25 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:26.872954 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b451aef3-8b17-41f0-a953-05cd66419a62 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:26.874381 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b451aef3-8b17-41f0-a953-05cd66419a62 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:26.886514 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b451aef3-8b17-41f0-a953-05cd66419a62 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:26.886972 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b451aef3-8b17-41f0-a953-05cd66419a62 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:26.888304 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b451aef3-8b17-41f0-a953-05cd66419a62 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:26.889060 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b451aef3-8b17-41f0-a953-05cd66419a62 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:27.067709 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-75ebba32-fb15-4774-b4fd-427e573fdefa tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:27.071524 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-75ebba32-fb15-4774-b4fd-427e573fdefa tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:27.098808 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-75ebba32-fb15-4774-b4fd-427e573fdefa tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:27.103419 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-75ebba32-fb15-4774-b4fd-427e573fdefa tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:27.113906 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-75ebba32-fb15-4774-b4fd-427e573fdefa tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:27.118662 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-75ebba32-fb15-4774-b4fd-427e573fdefa tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:27.166228 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b451aef3-8b17-41f0-a953-05cd66419a62 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:27.181016 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b451aef3-8b17-41f0-a953-05cd66419a62 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:27.183175 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b451aef3-8b17-41f0-a953-05cd66419a62 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:27.185508 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b451aef3-8b17-41f0-a953-05cd66419a62 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1723 microversion: 2.20 time: 0.317210 Jun 17 11:43:27.186807 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 140/285] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:43:26 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1723 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:43:27.251459 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-75ebba32-fb15-4774-b4fd-427e573fdefa tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:27.262720 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-75ebba32-fb15-4774-b4fd-427e573fdefa tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1241 microversion: 2.1 time: 0.202328 Jun 17 11:43:27.264025 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 146/286] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:27 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1241 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:43:28.220147 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-cab2e8f6-277b-4fc2-af85-cb4549e7a113 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:28.220147 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-cab2e8f6-277b-4fc2-af85-cb4549e7a113 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:28.229068 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cab2e8f6-277b-4fc2-af85-cb4549e7a113 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:28.229270 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f047c345-173a-4d38-abca-5ec49fac9e9d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:43:28.229754 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cab2e8f6-277b-4fc2-af85-cb4549e7a113 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:28.231909 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cab2e8f6-277b-4fc2-af85-cb4549e7a113 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:28.232735 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cab2e8f6-277b-4fc2-af85-cb4549e7a113 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:28.256301 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f047c345-173a-4d38-abca-5ec49fac9e9d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:28.256785 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f047c345-173a-4d38-abca-5ec49fac9e9d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:28.346089 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f047c345-173a-4d38-abca-5ec49fac9e9d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Going to try to stop instance {{(pid=124844) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 17 11:43:28.550901 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-cab2e8f6-277b-4fc2-af85-cb4549e7a113 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:28.566588 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-cab2e8f6-277b-4fc2-af85-cb4549e7a113 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:28.568619 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-cab2e8f6-277b-4fc2-af85-cb4549e7a113 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:28.577984 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-cab2e8f6-277b-4fc2-af85-cb4549e7a113 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1723 microversion: 2.20 time: 0.365108 Jun 17 11:43:28.598943 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 141/287] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:43:28 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1723 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:43:28.607970 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-311c66c9-b0c0-465f-8a80-d36fcb91f783 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:28.614913 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-311c66c9-b0c0-465f-8a80-d36fcb91f783 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:28.631784 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-311c66c9-b0c0-465f-8a80-d36fcb91f783 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:28.632227 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-311c66c9-b0c0-465f-8a80-d36fcb91f783 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:28.633002 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-311c66c9-b0c0-465f-8a80-d36fcb91f783 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:28.633427 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-311c66c9-b0c0-465f-8a80-d36fcb91f783 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:28.716577 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:43:28.834385 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f047c345-173a-4d38-abca-5ec49fac9e9d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "POST /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2/action" status: 202 len: 0 microversion: 2.1 time: 0.610577 Jun 17 11:43:28.839979 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 147/288] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jun 17 11:43:28 2022] POST /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2/action => generated 0 bytes in 613 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 17 11:43:28.850651 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6151578b-f019-4e9d-ab81-0e809e7be74d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:28.852743 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-6151578b-f019-4e9d-ab81-0e809e7be74d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:28.867448 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6151578b-f019-4e9d-ab81-0e809e7be74d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:28.868840 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6151578b-f019-4e9d-ab81-0e809e7be74d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:28.874159 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6151578b-f019-4e9d-ab81-0e809e7be74d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:28.881224 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6151578b-f019-4e9d-ab81-0e809e7be74d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:29.186701 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-311c66c9-b0c0-465f-8a80-d36fcb91f783 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:29.201754 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-311c66c9-b0c0-465f-8a80-d36fcb91f783 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1305 microversion: 2.1 time: 0.600937 Jun 17 11:43:29.202406 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 142/289] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:28 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1305 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:29.376828 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-6151578b-f019-4e9d-ab81-0e809e7be74d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:29.388963 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-6151578b-f019-4e9d-ab81-0e809e7be74d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1725 microversion: 2.1 time: 0.544682 Jun 17 11:43:29.391405 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 148/290] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:28 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1725 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:43:29.612715 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c3a1e91e-05cb-46ce-94af-2f90debfb756 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:29.614085 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c3a1e91e-05cb-46ce-94af-2f90debfb756 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:29.616792 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:43:29.630888 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c3a1e91e-05cb-46ce-94af-2f90debfb756 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:29.635141 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c3a1e91e-05cb-46ce-94af-2f90debfb756 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:29.636174 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c3a1e91e-05cb-46ce-94af-2f90debfb756 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:29.648958 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c3a1e91e-05cb-46ce-94af-2f90debfb756 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:29.901310 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c3a1e91e-05cb-46ce-94af-2f90debfb756 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:29.913724 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c3a1e91e-05cb-46ce-94af-2f90debfb756 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:29.917244 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c3a1e91e-05cb-46ce-94af-2f90debfb756 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:29.920344 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c3a1e91e-05cb-46ce-94af-2f90debfb756 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1723 microversion: 2.20 time: 0.324841 Jun 17 11:43:29.921559 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 143/291] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:43:29 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1723 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:43:30.222018 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-df3a108f-d078-4cb6-8f2d-9f3da0f9c0c8 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:30.222746 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-df3a108f-d078-4cb6-8f2d-9f3da0f9c0c8 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:30.232500 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-df3a108f-d078-4cb6-8f2d-9f3da0f9c0c8 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:30.233366 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-df3a108f-d078-4cb6-8f2d-9f3da0f9c0c8 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:30.234419 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-df3a108f-d078-4cb6-8f2d-9f3da0f9c0c8 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:30.236278 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-df3a108f-d078-4cb6-8f2d-9f3da0f9c0c8 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:30.423158 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a9a2d391-f59b-4dc5-a790-9556e0065207 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:30.426670 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a9a2d391-f59b-4dc5-a790-9556e0065207 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:30.444099 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a9a2d391-f59b-4dc5-a790-9556e0065207 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:30.445938 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a9a2d391-f59b-4dc5-a790-9556e0065207 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:30.448462 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a9a2d391-f59b-4dc5-a790-9556e0065207 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:30.451107 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a9a2d391-f59b-4dc5-a790-9556e0065207 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:30.624745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-df3a108f-d078-4cb6-8f2d-9f3da0f9c0c8 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:30.646543 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-df3a108f-d078-4cb6-8f2d-9f3da0f9c0c8 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1370 microversion: 2.1 time: 0.430415 Jun 17 11:43:30.649166 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 149/292] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:30 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1370 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:30.906756 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a9a2d391-f59b-4dc5-a790-9556e0065207 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:30.918377 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a9a2d391-f59b-4dc5-a790-9556e0065207 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1725 microversion: 2.1 time: 0.503528 Jun 17 11:43:30.919870 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 144/293] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:30 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1725 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:30.940687 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c7299911-012e-4f40-8f05-d9997af69776 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:30.941197 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c7299911-012e-4f40-8f05-d9997af69776 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:30.947940 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c7299911-012e-4f40-8f05-d9997af69776 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:30.948394 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c7299911-012e-4f40-8f05-d9997af69776 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:30.949177 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c7299911-012e-4f40-8f05-d9997af69776 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:30.949615 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c7299911-012e-4f40-8f05-d9997af69776 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:31.201788 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c7299911-012e-4f40-8f05-d9997af69776 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:31.229307 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c7299911-012e-4f40-8f05-d9997af69776 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:31.245904 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c7299911-012e-4f40-8f05-d9997af69776 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:31.245904 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c7299911-012e-4f40-8f05-d9997af69776 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1723 microversion: 2.20 time: 0.307639 Jun 17 11:43:31.245904 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 150/294] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:43:30 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1723 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:43:31.666741 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-d28d8b60-35bf-4768-a5f5-05e60a3005d4 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:31.667459 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-d28d8b60-35bf-4768-a5f5-05e60a3005d4 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:31.678368 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d28d8b60-35bf-4768-a5f5-05e60a3005d4 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:31.678843 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d28d8b60-35bf-4768-a5f5-05e60a3005d4 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:31.679683 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d28d8b60-35bf-4768-a5f5-05e60a3005d4 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:31.680114 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d28d8b60-35bf-4768-a5f5-05e60a3005d4 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:31.907086 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-c54e41b8-8842-4212-8073-322a4d61f298 req-dc3c2eec-e0fa-484d-b440-60a671f74262 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a27dd59-4638-430d-a484-d38ed6fcf923", "tag": "673fb82d-43c8-4e9f-bf01-47ee2806f33a"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:43:31.933510 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-c54e41b8-8842-4212-8073-322a4d61f298 req-dc3c2eec-e0fa-484d-b440-60a671f74262 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:31.933510 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-c54e41b8-8842-4212-8073-322a4d61f298 req-dc3c2eec-e0fa-484d-b440-60a671f74262 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:31.961411 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-c54e41b8-8842-4212-8073-322a4d61f298 req-dc3c2eec-e0fa-484d-b440-60a671f74262 service nova] Creating event network-changed:673fb82d-43c8-4e9f-bf01-47ee2806f33a for instance 9a27dd59-4638-430d-a484-d38ed6fcf923 on hv-cinder-83716 Jun 17 11:43:31.968405 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-c54e41b8-8842-4212-8073-322a4d61f298 req-dc3c2eec-e0fa-484d-b440-60a671f74262 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065842 Jun 17 11:43:31.969017 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 151/295] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:43:32.001889 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-14b64143-44f4-433e-8a2e-cd3651d05229 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:32.002680 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-14b64143-44f4-433e-8a2e-cd3651d05229 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:32.011510 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-14b64143-44f4-433e-8a2e-cd3651d05229 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:32.016387 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-14b64143-44f4-433e-8a2e-cd3651d05229 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:32.017570 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-14b64143-44f4-433e-8a2e-cd3651d05229 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:32.018228 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-14b64143-44f4-433e-8a2e-cd3651d05229 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:32.072143 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-d28d8b60-35bf-4768-a5f5-05e60a3005d4 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:32.084748 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-d28d8b60-35bf-4768-a5f5-05e60a3005d4 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1370 microversion: 2.1 time: 0.422720 Jun 17 11:43:32.104105 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 145/296] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:31 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1370 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:43:32.273613 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-7e535116-8603-4915-81d8-518cbd7ef534 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:32.274651 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-7e535116-8603-4915-81d8-518cbd7ef534 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:32.296527 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7e535116-8603-4915-81d8-518cbd7ef534 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:32.296527 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7e535116-8603-4915-81d8-518cbd7ef534 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:32.297802 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7e535116-8603-4915-81d8-518cbd7ef534 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:32.301332 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7e535116-8603-4915-81d8-518cbd7ef534 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:32.334643 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-14b64143-44f4-433e-8a2e-cd3651d05229 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:32.354341 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-14b64143-44f4-433e-8a2e-cd3651d05229 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1725 microversion: 2.1 time: 0.381012 Jun 17 11:43:32.355015 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 152/297] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:31 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1725 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:32.579350 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-7e535116-8603-4915-81d8-518cbd7ef534 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:32.589375 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-7e535116-8603-4915-81d8-518cbd7ef534 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:32.595254 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-7e535116-8603-4915-81d8-518cbd7ef534 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:32.595254 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-7e535116-8603-4915-81d8-518cbd7ef534 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1723 microversion: 2.20 time: 0.325972 Jun 17 11:43:32.595254 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 146/298] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:43:32 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1723 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:43:33.114954 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4697fb15-5f2a-4094-94b7-0ee1b582d1fe tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:33.119408 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4697fb15-5f2a-4094-94b7-0ee1b582d1fe tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:33.125408 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4697fb15-5f2a-4094-94b7-0ee1b582d1fe tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:33.126333 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4697fb15-5f2a-4094-94b7-0ee1b582d1fe tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:33.141802 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4697fb15-5f2a-4094-94b7-0ee1b582d1fe tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:33.141802 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4697fb15-5f2a-4094-94b7-0ee1b582d1fe tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:33.385602 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ac32631d-8e04-43f0-ad3e-b1dbe99d673d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:33.390251 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-ac32631d-8e04-43f0-ad3e-b1dbe99d673d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:33.411738 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ac32631d-8e04-43f0-ad3e-b1dbe99d673d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:33.412407 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ac32631d-8e04-43f0-ad3e-b1dbe99d673d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:33.413386 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ac32631d-8e04-43f0-ad3e-b1dbe99d673d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:33.413960 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ac32631d-8e04-43f0-ad3e-b1dbe99d673d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:33.484034 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4697fb15-5f2a-4094-94b7-0ee1b582d1fe tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:33.515322 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4697fb15-5f2a-4094-94b7-0ee1b582d1fe tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1370 microversion: 2.1 time: 0.405866 Jun 17 11:43:33.516161 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 153/299] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:33 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1370 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:33.619262 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5cc11992-8ecd-4346-b0c6-3e186d99da1f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:33.620165 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-5cc11992-8ecd-4346-b0c6-3e186d99da1f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:33.629579 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5cc11992-8ecd-4346-b0c6-3e186d99da1f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:33.629579 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5cc11992-8ecd-4346-b0c6-3e186d99da1f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:33.629579 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5cc11992-8ecd-4346-b0c6-3e186d99da1f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:33.629579 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5cc11992-8ecd-4346-b0c6-3e186d99da1f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:33.655180 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ac32631d-8e04-43f0-ad3e-b1dbe99d673d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:33.663714 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-ac32631d-8e04-43f0-ad3e-b1dbe99d673d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1725 microversion: 2.1 time: 0.293005 Jun 17 11:43:33.664306 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 147/300] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:33 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1725 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:33.780107 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5cc11992-8ecd-4346-b0c6-3e186d99da1f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:33.788646 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5cc11992-8ecd-4346-b0c6-3e186d99da1f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:33.790264 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5cc11992-8ecd-4346-b0c6-3e186d99da1f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:33.791577 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5cc11992-8ecd-4346-b0c6-3e186d99da1f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1723 microversion: 2.20 time: 0.176348 Jun 17 11:43:33.792202 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 154/301] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:43:33 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:43:34.544222 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-11082b8d-45cc-4681-a8a1-a57354be039c tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:34.545169 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-11082b8d-45cc-4681-a8a1-a57354be039c tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:34.556058 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-11082b8d-45cc-4681-a8a1-a57354be039c tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:34.556510 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-11082b8d-45cc-4681-a8a1-a57354be039c tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:34.557305 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-11082b8d-45cc-4681-a8a1-a57354be039c tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:34.557861 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-11082b8d-45cc-4681-a8a1-a57354be039c tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:34.664435 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:43:34.682057 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-60466503-6cb9-4e7e-a05d-bbac35dd9318 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:34.682722 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-60466503-6cb9-4e7e-a05d-bbac35dd9318 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:34.684548 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=10 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:43:34.696285 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-60466503-6cb9-4e7e-a05d-bbac35dd9318 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:34.697735 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-60466503-6cb9-4e7e-a05d-bbac35dd9318 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:34.699868 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-60466503-6cb9-4e7e-a05d-bbac35dd9318 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:34.701245 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-60466503-6cb9-4e7e-a05d-bbac35dd9318 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:34.859329 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-11082b8d-45cc-4681-a8a1-a57354be039c tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:34.896439 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-11082b8d-45cc-4681-a8a1-a57354be039c tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1370 microversion: 2.1 time: 0.355342 Jun 17 11:43:34.898742 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 148/302] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:34 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1370 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:34.925572 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-60466503-6cb9-4e7e-a05d-bbac35dd9318 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:34.927581 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c138b0aa-e109-4892-9f0e-d332ad486813 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:34.929939 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c138b0aa-e109-4892-9f0e-d332ad486813 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:34.934975 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-60466503-6cb9-4e7e-a05d-bbac35dd9318 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1725 microversion: 2.1 time: 0.256374 Jun 17 11:43:34.936581 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 155/303] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:34 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1725 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:34.945294 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c138b0aa-e109-4892-9f0e-d332ad486813 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:34.946056 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c138b0aa-e109-4892-9f0e-d332ad486813 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:34.947020 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c138b0aa-e109-4892-9f0e-d332ad486813 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:34.947781 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c138b0aa-e109-4892-9f0e-d332ad486813 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:35.161627 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c138b0aa-e109-4892-9f0e-d332ad486813 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:35.171591 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c138b0aa-e109-4892-9f0e-d332ad486813 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:35.173573 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c138b0aa-e109-4892-9f0e-d332ad486813 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:35.174983 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c138b0aa-e109-4892-9f0e-d332ad486813 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1723 microversion: 2.20 time: 0.273742 Jun 17 11:43:35.187002 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 149/304] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:43:34 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1723 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:43:35.921095 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-17c7d343-1e24-45fb-ae50-522517df6b32 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:35.927924 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-17c7d343-1e24-45fb-ae50-522517df6b32 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:35.953787 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-17c7d343-1e24-45fb-ae50-522517df6b32 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:35.956376 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-17c7d343-1e24-45fb-ae50-522517df6b32 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:35.959766 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-17c7d343-1e24-45fb-ae50-522517df6b32 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:35.960706 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-17c7d343-1e24-45fb-ae50-522517df6b32 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:35.987126 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c6ea45cd-92a7-4aab-bf48-1dabc8e3811c tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:35.988538 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c6ea45cd-92a7-4aab-bf48-1dabc8e3811c tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:36.005100 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c6ea45cd-92a7-4aab-bf48-1dabc8e3811c tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:36.006161 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c6ea45cd-92a7-4aab-bf48-1dabc8e3811c tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:36.008047 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c6ea45cd-92a7-4aab-bf48-1dabc8e3811c tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:36.009206 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c6ea45cd-92a7-4aab-bf48-1dabc8e3811c tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:36.040184 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=4 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:43:36.312352 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c6ea45cd-92a7-4aab-bf48-1dabc8e3811c tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:36.322950 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c6ea45cd-92a7-4aab-bf48-1dabc8e3811c tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1725 microversion: 2.1 time: 0.342733 Jun 17 11:43:36.323946 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 150/305] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:35 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1725 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:36.328863 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-17c7d343-1e24-45fb-ae50-522517df6b32 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:36.330503 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-fff6d204-f53c-4182-ab29-6db27f79e3fd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:36.331610 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-fff6d204-f53c-4182-ab29-6db27f79e3fd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:36.339176 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fff6d204-f53c-4182-ab29-6db27f79e3fd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:36.340087 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fff6d204-f53c-4182-ab29-6db27f79e3fd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:36.342431 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fff6d204-f53c-4182-ab29-6db27f79e3fd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:36.343055 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fff6d204-f53c-4182-ab29-6db27f79e3fd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:36.344028 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-17c7d343-1e24-45fb-ae50-522517df6b32 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1370 microversion: 2.1 time: 0.431893 Jun 17 11:43:36.345297 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 156/306] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:35 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1370 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:36.522225 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-fff6d204-f53c-4182-ab29-6db27f79e3fd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:36.536490 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-fff6d204-f53c-4182-ab29-6db27f79e3fd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:36.540021 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-fff6d204-f53c-4182-ab29-6db27f79e3fd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:36.541453 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-fff6d204-f53c-4182-ab29-6db27f79e3fd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1723 microversion: 2.20 time: 0.216259 Jun 17 11:43:36.542254 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 151/307] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:43:36 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:43:37.156614 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d4ccbdba-aefc-4df4-962d-1c6a8faa4e9b tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Action: 'create', calling method: .version_select at 0x7f9c77208280>, body: {"keypair": {"name": "tempest-keypair-382923722", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGc6Vxt12Kuvm4B1dAVx0J6ebdpEoVnLjJkxbaWX5YncokgCUl9lvnY8TQKug0Ild4TTppgiHpNdSJX/T5AzEVvAzuKxzQ9MMlvK7r9MSm9kOBgJpKC8WVYIRM/YmbuDog=="}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:43:37.210755 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-d4ccbdba-aefc-4df4-962d-1c6a8faa4e9b tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Getting quotas for project c58cf63264414f30a98161f6027daad0. Resources: {'key_pairs'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 11:43:37.222998 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-d4ccbdba-aefc-4df4-962d-1c6a8faa4e9b tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Getting quotas for user 2e58eacbbb9e41fdbbb13f5b39be782a and project c58cf63264414f30a98161f6027daad0. Resources: {'key_pairs'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 11:43:37.342687 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f3230f56-1e82-4bf7-9aeb-a3574a312b5c tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:37.343423 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f3230f56-1e82-4bf7-9aeb-a3574a312b5c tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:37.350292 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f3230f56-1e82-4bf7-9aeb-a3574a312b5c tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:37.350747 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f3230f56-1e82-4bf7-9aeb-a3574a312b5c tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:37.351554 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f3230f56-1e82-4bf7-9aeb-a3574a312b5c tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:37.351996 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f3230f56-1e82-4bf7-9aeb-a3574a312b5c tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:37.431617 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d4ccbdba-aefc-4df4-962d-1c6a8faa4e9b tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.282613 Jun 17 11:43:37.432337 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 157/308] 10.222.0.45 () {60 vars in 1158 bytes} [Fri Jun 17 11:43:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:43:37.438492 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5529fd91-e039-4509-bb85-42775563641a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:37.440182 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-5529fd91-e039-4509-bb85-42775563641a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:37.448701 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5529fd91-e039-4509-bb85-42775563641a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:37.449546 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5529fd91-e039-4509-bb85-42775563641a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:37.450661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5529fd91-e039-4509-bb85-42775563641a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:37.451643 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5529fd91-e039-4509-bb85-42775563641a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:37.702862 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f3230f56-1e82-4bf7-9aeb-a3574a312b5c tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:37.707301 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:43:37.721266 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f3230f56-1e82-4bf7-9aeb-a3574a312b5c tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1725 microversion: 2.1 time: 0.382469 Jun 17 11:43:37.722174 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 152/309] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:37 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1725 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:43:37.737829 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f48439f6-2b15-41f7-9cd3-6e6d843ca608 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:37.737829 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f48439f6-2b15-41f7-9cd3-6e6d843ca608 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:37.761444 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f48439f6-2b15-41f7-9cd3-6e6d843ca608 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:37.766927 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f48439f6-2b15-41f7-9cd3-6e6d843ca608 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:37.766927 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f48439f6-2b15-41f7-9cd3-6e6d843ca608 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:37.766927 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f48439f6-2b15-41f7-9cd3-6e6d843ca608 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:37.825873 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5529fd91-e039-4509-bb85-42775563641a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:37.838461 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5529fd91-e039-4509-bb85-42775563641a tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1370 microversion: 2.1 time: 0.403239 Jun 17 11:43:37.842112 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 158/310] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:37 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1370 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:37.958003 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-85ac3a1a-9519-4539-a534-2a5599a003fa req-21bdb848-6aed-4be6-b5a7-4a1fc36bbde4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a27dd59-4638-430d-a484-d38ed6fcf923", "name": "network-vif-plugged", "status": "completed", "tag": "673fb82d-43c8-4e9f-bf01-47ee2806f33a"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:43:37.975734 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-85ac3a1a-9519-4539-a534-2a5599a003fa req-21bdb848-6aed-4be6-b5a7-4a1fc36bbde4 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:37.976924 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-85ac3a1a-9519-4539-a534-2a5599a003fa req-21bdb848-6aed-4be6-b5a7-4a1fc36bbde4 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:38.001703 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-85ac3a1a-9519-4539-a534-2a5599a003fa req-21bdb848-6aed-4be6-b5a7-4a1fc36bbde4 service nova] Creating event network-vif-plugged:673fb82d-43c8-4e9f-bf01-47ee2806f33a for instance 9a27dd59-4638-430d-a484-d38ed6fcf923 on hv-cinder-83716 Jun 17 11:43:38.011360 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-85ac3a1a-9519-4539-a534-2a5599a003fa req-21bdb848-6aed-4be6-b5a7-4a1fc36bbde4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067688 Jun 17 11:43:38.014066 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 159/311] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:43:38.078147 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f48439f6-2b15-41f7-9cd3-6e6d843ca608 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:38.098445 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f48439f6-2b15-41f7-9cd3-6e6d843ca608 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:38.102532 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f48439f6-2b15-41f7-9cd3-6e6d843ca608 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:38.105014 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f48439f6-2b15-41f7-9cd3-6e6d843ca608 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1723 microversion: 2.20 time: 0.378063 Jun 17 11:43:38.106044 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 153/312] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:43:37 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1723 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:43:38.744058 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-fa43356b-978f-4a54-8de4-9181aa039be9 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:38.744934 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-fa43356b-978f-4a54-8de4-9181aa039be9 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:38.760627 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fa43356b-978f-4a54-8de4-9181aa039be9 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:38.761309 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fa43356b-978f-4a54-8de4-9181aa039be9 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:38.771601 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fa43356b-978f-4a54-8de4-9181aa039be9 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:38.771601 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fa43356b-978f-4a54-8de4-9181aa039be9 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:38.877654 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e30a30fe-9082-4137-9483-9bc8b5fa7de2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:38.879620 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-e30a30fe-9082-4137-9483-9bc8b5fa7de2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:38.904147 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e30a30fe-9082-4137-9483-9bc8b5fa7de2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:38.918860 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e30a30fe-9082-4137-9483-9bc8b5fa7de2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:38.924866 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e30a30fe-9082-4137-9483-9bc8b5fa7de2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:38.926397 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e30a30fe-9082-4137-9483-9bc8b5fa7de2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:38.962988 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-fa43356b-978f-4a54-8de4-9181aa039be9 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:38.973942 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-fa43356b-978f-4a54-8de4-9181aa039be9 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1725 microversion: 2.1 time: 0.236649 Jun 17 11:43:38.974945 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 160/313] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:38 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1725 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:39.129888 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-18523d8f-712e-42d8-8932-3bb41541d9b2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:39.130235 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-18523d8f-712e-42d8-8932-3bb41541d9b2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:39.138840 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-18523d8f-712e-42d8-8932-3bb41541d9b2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:39.140713 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-18523d8f-712e-42d8-8932-3bb41541d9b2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:39.141754 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-18523d8f-712e-42d8-8932-3bb41541d9b2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:39.143762 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-18523d8f-712e-42d8-8932-3bb41541d9b2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:39.225504 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-e30a30fe-9082-4137-9483-9bc8b5fa7de2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:39.245180 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-e30a30fe-9082-4137-9483-9bc8b5fa7de2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1370 microversion: 2.1 time: 0.389714 Jun 17 11:43:39.246771 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 154/314] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:38 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1370 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:39.419797 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-18523d8f-712e-42d8-8932-3bb41541d9b2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:39.432976 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-18523d8f-712e-42d8-8932-3bb41541d9b2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:39.434261 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-18523d8f-712e-42d8-8932-3bb41541d9b2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:39.437907 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-18523d8f-712e-42d8-8932-3bb41541d9b2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1723 microversion: 2.20 time: 0.311539 Jun 17 11:43:39.444598 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 161/315] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:43:39 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1723 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:43:39.994246 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e65a9c85-be10-4a2c-837d-8487332566be tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:39.996785 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-e65a9c85-be10-4a2c-837d-8487332566be tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:40.005064 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e65a9c85-be10-4a2c-837d-8487332566be tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:40.006026 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e65a9c85-be10-4a2c-837d-8487332566be tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:40.007288 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e65a9c85-be10-4a2c-837d-8487332566be tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:40.008212 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e65a9c85-be10-4a2c-837d-8487332566be tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:40.209523 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-e65a9c85-be10-4a2c-837d-8487332566be tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:40.223517 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-e65a9c85-be10-4a2c-837d-8487332566be tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1725 microversion: 2.1 time: 0.233588 Jun 17 11:43:40.225851 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 155/316] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:39 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1725 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:40.265608 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a9a512ce-c78b-41cd-8803-312f51f91055 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:40.266296 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a9a512ce-c78b-41cd-8803-312f51f91055 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:40.268749 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:43:40.275848 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a9a512ce-c78b-41cd-8803-312f51f91055 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:40.277323 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a9a512ce-c78b-41cd-8803-312f51f91055 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:40.277323 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a9a512ce-c78b-41cd-8803-312f51f91055 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:40.277769 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a9a512ce-c78b-41cd-8803-312f51f91055 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:40.451888 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a9a512ce-c78b-41cd-8803-312f51f91055 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:40.461390 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a9a512ce-c78b-41cd-8803-312f51f91055 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1370 microversion: 2.1 time: 0.200117 Jun 17 11:43:40.461816 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c1354b3a-c714-4f30-980e-d2d67b14b2b0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:40.462758 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c1354b3a-c714-4f30-980e-d2d67b14b2b0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:40.472882 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 162/317] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:40 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1370 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:40.486432 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c1354b3a-c714-4f30-980e-d2d67b14b2b0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:40.497186 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c1354b3a-c714-4f30-980e-d2d67b14b2b0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:40.497186 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c1354b3a-c714-4f30-980e-d2d67b14b2b0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:40.497186 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c1354b3a-c714-4f30-980e-d2d67b14b2b0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:40.730452 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c1354b3a-c714-4f30-980e-d2d67b14b2b0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:40.748090 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c1354b3a-c714-4f30-980e-d2d67b14b2b0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:40.755025 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c1354b3a-c714-4f30-980e-d2d67b14b2b0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:40.760576 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c1354b3a-c714-4f30-980e-d2d67b14b2b0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1723 microversion: 2.20 time: 0.306680 Jun 17 11:43:40.772821 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 156/318] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:43:40 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1723 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:43:40.968204 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c4049c17-0f0c-4854-b468-03316849eae1 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2021719616", "imageRef": "272eb2b7-ddf0-433f-8be8-cdc13c01be77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "562be4fa-7f02-4e16-ab0e-484de596db99"}], "security_groups": [{"name": "tempest-securitygroup--1753164142"}], "key_name": "tempest-keypair-382923722", "user_data": "}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:43:41.156425 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.network.neutron [None req-c4049c17-0f0c-4854-b468-03316849eae1 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] validate_networks() for [('562be4fa-7f02-4e16-ab0e-484de596db99', None, None, None, None, None)] {{(pid=124844) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 11:43:41.243264 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-65b96cc3-39c8-4c51-809e-f14bf80fa83e tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:41.244647 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-65b96cc3-39c8-4c51-809e-f14bf80fa83e tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:41.252430 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-65b96cc3-39c8-4c51-809e-f14bf80fa83e tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:41.253231 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-65b96cc3-39c8-4c51-809e-f14bf80fa83e tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:41.254113 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-65b96cc3-39c8-4c51-809e-f14bf80fa83e tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:41.254753 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-65b96cc3-39c8-4c51-809e-f14bf80fa83e tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:41.499087 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-65b96cc3-39c8-4c51-809e-f14bf80fa83e tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:41.507296 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-65b96cc3-39c8-4c51-809e-f14bf80fa83e tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1725 microversion: 2.1 time: 0.268964 Jun 17 11:43:41.507903 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 157/319] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:41 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1725 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:43:41.512652 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f7da8070-b2c4-409d-9531-e6f03680a680 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:41.514173 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f7da8070-b2c4-409d-9531-e6f03680a680 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:41.520555 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f7da8070-b2c4-409d-9531-e6f03680a680 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:41.521218 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f7da8070-b2c4-409d-9531-e6f03680a680 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:41.522153 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f7da8070-b2c4-409d-9531-e6f03680a680 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:41.523934 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f7da8070-b2c4-409d-9531-e6f03680a680 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:41.895334 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f7da8070-b2c4-409d-9531-e6f03680a680 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:41.923943 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f7da8070-b2c4-409d-9531-e6f03680a680 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1564 microversion: 2.1 time: 0.414220 Jun 17 11:43:41.925773 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 158/320] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:41 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1564 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:41.936665 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f21917d8-d5b3-4fcc-a31c-953ccfe67061 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:41.938613 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f21917d8-d5b3-4fcc-a31c-953ccfe67061 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:41.956627 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f21917d8-d5b3-4fcc-a31c-953ccfe67061 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:41.957435 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f21917d8-d5b3-4fcc-a31c-953ccfe67061 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:41.959148 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f21917d8-d5b3-4fcc-a31c-953ccfe67061 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:41.960053 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f21917d8-d5b3-4fcc-a31c-953ccfe67061 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:41.985987 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-c4049c17-0f0c-4854-b468-03316849eae1 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Flavor limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 11:43:41.986605 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-c4049c17-0f0c-4854-b468-03316849eae1 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Image limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 11:43:41.988209 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-c4049c17-0f0c-4854-b468-03316849eae1 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Flavor pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 11:43:41.988437 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-c4049c17-0f0c-4854-b468-03316849eae1 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Image pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 11:43:41.989187 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-c4049c17-0f0c-4854-b468-03316849eae1 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 11:43:42.021348 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c4049c17-0f0c-4854-b468-03316849eae1 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:42.022226 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c4049c17-0f0c-4854-b468-03316849eae1 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:42.024577 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c4049c17-0f0c-4854-b468-03316849eae1 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:42.028461 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c4049c17-0f0c-4854-b468-03316849eae1 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:42.096002 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-c4049c17-0f0c-4854-b468-03316849eae1 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Getting quotas for project c58cf63264414f30a98161f6027daad0. Resources: {'instances', 'ram', 'cores'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 11:43:42.101604 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-c4049c17-0f0c-4854-b468-03316849eae1 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Getting quotas for user 2e58eacbbb9e41fdbbb13f5b39be782a and project c58cf63264414f30a98161f6027daad0. Resources: {'instances', 'ram', 'cores'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 11:43:42.119792 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c4049c17-0f0c-4854-b468-03316849eae1 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Going to run 1 instances... {{(pid=124844) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 11:43:42.123877 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c4049c17-0f0c-4854-b468-03316849eae1 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: a8d94a32-3230-4516-9233-fa758d450798] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='272eb2b7-ddf0-433f-8be8-cdc13c01be77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 11:43:42.319161 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c4049c17-0f0c-4854-b468-03316849eae1 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.354323 Jun 17 11:43:42.324738 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 163/321] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 17 11:43:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 1363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 17 11:43:42.339505 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-71180487-b5ba-4c4b-9477-05f354a292ea tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:42.340440 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-71180487-b5ba-4c4b-9477-05f354a292ea tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:42.354729 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-71180487-b5ba-4c4b-9477-05f354a292ea tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:42.355504 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-71180487-b5ba-4c4b-9477-05f354a292ea tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:42.356755 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-71180487-b5ba-4c4b-9477-05f354a292ea tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:42.357419 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-71180487-b5ba-4c4b-9477-05f354a292ea tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:42.639434 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-71180487-b5ba-4c4b-9477-05f354a292ea tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.312427 Jun 17 11:43:42.640260 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 164/322] 10.222.0.45 () {58 vars in 1274 bytes} [Fri Jun 17 11:43:42 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923/os-interface => generated 284 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:43:42.645313 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-53a56fef-4ba7-4fd6-a7a4-3cff1a29a4e0 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:42.646808 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-53a56fef-4ba7-4fd6-a7a4-3cff1a29a4e0 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: a8d94a32-3230-4516-9233-fa758d450798] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:42.648019 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f21917d8-d5b3-4fcc-a31c-953ccfe67061 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:42.659482 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f21917d8-d5b3-4fcc-a31c-953ccfe67061 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:42.678811 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f21917d8-d5b3-4fcc-a31c-953ccfe67061 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:42.680530 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f21917d8-d5b3-4fcc-a31c-953ccfe67061 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1744 microversion: 2.20 time: 0.751756 Jun 17 11:43:42.681252 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 159/323] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:43:41 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1744 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:43:42.694168 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b1fe0477-366d-40bf-a193-16428e44e683 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:42.695065 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b1fe0477-366d-40bf-a193-16428e44e683 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:42.702983 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b1fe0477-366d-40bf-a193-16428e44e683 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:42.703871 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b1fe0477-366d-40bf-a193-16428e44e683 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:42.704898 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b1fe0477-366d-40bf-a193-16428e44e683 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:42.705594 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b1fe0477-366d-40bf-a193-16428e44e683 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:42.725746 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-53a56fef-4ba7-4fd6-a7a4-3cff1a29a4e0 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:42.735748 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-53a56fef-4ba7-4fd6-a7a4-3cff1a29a4e0 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798" status: 200 len: 1241 microversion: 2.1 time: 0.093562 Jun 17 11:43:42.736653 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 165/324] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:42 2022] GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798 => generated 1241 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:42.940780 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b1fe0477-366d-40bf-a193-16428e44e683 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:42.952940 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b1fe0477-366d-40bf-a193-16428e44e683 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1725 microversion: 2.1 time: 0.266621 Jun 17 11:43:42.953750 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 160/325] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:42 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1725 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:43.712639 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ef2800a2-718f-47bf-bb29-eb85481f9b23 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:43.713276 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ef2800a2-718f-47bf-bb29-eb85481f9b23 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:43.733336 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ef2800a2-718f-47bf-bb29-eb85481f9b23 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:43.735746 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ef2800a2-718f-47bf-bb29-eb85481f9b23 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:43.755593 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-915edb2b-236d-4bed-a3f5-c2850cbcdaa4 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:43.756985 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-915edb2b-236d-4bed-a3f5-c2850cbcdaa4 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: a8d94a32-3230-4516-9233-fa758d450798] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:43.762356 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ef2800a2-718f-47bf-bb29-eb85481f9b23 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:43.771518 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ef2800a2-718f-47bf-bb29-eb85481f9b23 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:43.780094 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-915edb2b-236d-4bed-a3f5-c2850cbcdaa4 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:43.782248 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-915edb2b-236d-4bed-a3f5-c2850cbcdaa4 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:43.787501 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-915edb2b-236d-4bed-a3f5-c2850cbcdaa4 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:43.787501 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-915edb2b-236d-4bed-a3f5-c2850cbcdaa4 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:43.996869 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-915edb2b-236d-4bed-a3f5-c2850cbcdaa4 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:44.005338 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-915edb2b-236d-4bed-a3f5-c2850cbcdaa4 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798" status: 200 len: 1245 microversion: 2.1 time: 0.255647 Jun 17 11:43:44.006197 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 161/326] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:43 2022] GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798 => generated 1245 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:43:44.022591 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-cf28cbca-981f-4e37-9e5e-b2ac206bdb90 req-52884dbb-1852-4c25-9a34-dc45cd9139d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71050501-8f84-4701-a013-bfc7a4459972", "name": "network-vif-plugged", "status": "completed", "tag": "4f9d2fad-e808-44df-adda-539bddcec93d"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:43:44.034795 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-cf28cbca-981f-4e37-9e5e-b2ac206bdb90 req-52884dbb-1852-4c25-9a34-dc45cd9139d0 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:44.035635 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-cf28cbca-981f-4e37-9e5e-b2ac206bdb90 req-52884dbb-1852-4c25-9a34-dc45cd9139d0 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:44.060928 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-cf28cbca-981f-4e37-9e5e-b2ac206bdb90 req-52884dbb-1852-4c25-9a34-dc45cd9139d0 service nova] Creating event network-vif-plugged:4f9d2fad-e808-44df-adda-539bddcec93d for instance 71050501-8f84-4701-a013-bfc7a4459972 on hv-cinder-83716 Jun 17 11:43:44.115453 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-cf28cbca-981f-4e37-9e5e-b2ac206bdb90 req-52884dbb-1852-4c25-9a34-dc45cd9139d0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096487 Jun 17 11:43:44.125281 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 162/327] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:43:44.140532 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6dd5c6fe-1654-44be-94fc-8152b669438a tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:44.141957 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-6dd5c6fe-1654-44be-94fc-8152b669438a tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:44.166543 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6dd5c6fe-1654-44be-94fc-8152b669438a tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:44.171433 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6dd5c6fe-1654-44be-94fc-8152b669438a tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:44.172569 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6dd5c6fe-1654-44be-94fc-8152b669438a tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:44.175463 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6dd5c6fe-1654-44be-94fc-8152b669438a tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:44.308579 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ef2800a2-718f-47bf-bb29-eb85481f9b23 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:44.325028 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ef2800a2-718f-47bf-bb29-eb85481f9b23 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:44.334416 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ef2800a2-718f-47bf-bb29-eb85481f9b23 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:44.335826 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ef2800a2-718f-47bf-bb29-eb85481f9b23 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1744 microversion: 2.20 time: 0.629331 Jun 17 11:43:44.347992 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 166/328] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:43:43 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1744 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:43:44.463748 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6dd5c6fe-1654-44be-94fc-8152b669438a tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:44.478992 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-6dd5c6fe-1654-44be-94fc-8152b669438a tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1725 microversion: 2.1 time: 0.344481 Jun 17 11:43:44.495764 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 163/329] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:44 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1725 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:44.719282 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-833c558c-a5ee-4b1f-ad8b-d3a4843002b0 req-523b1ac8-ac91-40f3-88a2-8f048ad6bd90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a27dd59-4638-430d-a484-d38ed6fcf923", "tag": "673fb82d-43c8-4e9f-bf01-47ee2806f33a"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:43:44.746022 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-833c558c-a5ee-4b1f-ad8b-d3a4843002b0 req-523b1ac8-ac91-40f3-88a2-8f048ad6bd90 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:44.746801 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-833c558c-a5ee-4b1f-ad8b-d3a4843002b0 req-523b1ac8-ac91-40f3-88a2-8f048ad6bd90 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:44.776616 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-833c558c-a5ee-4b1f-ad8b-d3a4843002b0 req-523b1ac8-ac91-40f3-88a2-8f048ad6bd90 service nova] Creating event network-changed:673fb82d-43c8-4e9f-bf01-47ee2806f33a for instance 9a27dd59-4638-430d-a484-d38ed6fcf923 on hv-cinder-83716 Jun 17 11:43:44.783601 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-833c558c-a5ee-4b1f-ad8b-d3a4843002b0 req-523b1ac8-ac91-40f3-88a2-8f048ad6bd90 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069412 Jun 17 11:43:44.784355 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 167/330] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:43:45.028352 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-37d0bea2-a466-4bd9-82b3-3ebf73fd9995 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:45.029817 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-37d0bea2-a466-4bd9-82b3-3ebf73fd9995 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: a8d94a32-3230-4516-9233-fa758d450798] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:45.053499 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-37d0bea2-a466-4bd9-82b3-3ebf73fd9995 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:45.062168 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-37d0bea2-a466-4bd9-82b3-3ebf73fd9995 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:45.063391 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-37d0bea2-a466-4bd9-82b3-3ebf73fd9995 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:45.063873 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-37d0bea2-a466-4bd9-82b3-3ebf73fd9995 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:45.199233 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-37d0bea2-a466-4bd9-82b3-3ebf73fd9995 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:45.210728 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-37d0bea2-a466-4bd9-82b3-3ebf73fd9995 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798" status: 200 len: 1293 microversion: 2.1 time: 0.190241 Jun 17 11:43:45.222140 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 164/331] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:45 2022] GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798 => generated 1293 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:45.361328 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d933b7a3-bc12-40a8-a023-73b4de1a3318 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:45.365192 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d933b7a3-bc12-40a8-a023-73b4de1a3318 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:45.394960 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d933b7a3-bc12-40a8-a023-73b4de1a3318 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:45.396452 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d933b7a3-bc12-40a8-a023-73b4de1a3318 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:45.399189 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d933b7a3-bc12-40a8-a023-73b4de1a3318 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:45.401383 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d933b7a3-bc12-40a8-a023-73b4de1a3318 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:45.504914 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2592d5c2-cded-4c38-ab16-ec96302ad4ae tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:45.505533 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2592d5c2-cded-4c38-ab16-ec96302ad4ae tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:45.514857 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2592d5c2-cded-4c38-ab16-ec96302ad4ae tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:45.515310 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2592d5c2-cded-4c38-ab16-ec96302ad4ae tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:45.522043 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2592d5c2-cded-4c38-ab16-ec96302ad4ae tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:45.522500 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2592d5c2-cded-4c38-ab16-ec96302ad4ae tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:45.898538 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d933b7a3-bc12-40a8-a023-73b4de1a3318 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:45.914447 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d933b7a3-bc12-40a8-a023-73b4de1a3318 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:45.921025 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d933b7a3-bc12-40a8-a023-73b4de1a3318 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:45.923097 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d933b7a3-bc12-40a8-a023-73b4de1a3318 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1739 microversion: 2.20 time: 0.569784 Jun 17 11:43:45.934010 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 168/332] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:43:45 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1739 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:43:46.266113 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-9646fa89-d55f-4389-b808-85e974625659 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:46.284715 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-9646fa89-d55f-4389-b808-85e974625659 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: a8d94a32-3230-4516-9233-fa758d450798] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:46.330219 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9646fa89-d55f-4389-b808-85e974625659 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:46.342598 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2592d5c2-cded-4c38-ab16-ec96302ad4ae tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:46.344218 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9646fa89-d55f-4389-b808-85e974625659 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:46.345929 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9646fa89-d55f-4389-b808-85e974625659 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:46.359878 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2592d5c2-cded-4c38-ab16-ec96302ad4ae tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1725 microversion: 2.1 time: 0.859751 Jun 17 11:43:46.361462 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 165/333] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:45 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1725 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:43:46.371657 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9646fa89-d55f-4389-b808-85e974625659 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:46.588474 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:43:46.758246 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-9646fa89-d55f-4389-b808-85e974625659 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:46.766734 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-9646fa89-d55f-4389-b808-85e974625659 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798" status: 200 len: 1299 microversion: 2.1 time: 0.540932 Jun 17 11:43:46.773663 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 169/334] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:46 2022] GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798 => generated 1299 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:46.943026 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-db18f072-7b58-4656-8b75-4c8bb196d998 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:46.945073 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-db18f072-7b58-4656-8b75-4c8bb196d998 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:46.959202 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-db18f072-7b58-4656-8b75-4c8bb196d998 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:46.959683 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-db18f072-7b58-4656-8b75-4c8bb196d998 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:46.964312 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-db18f072-7b58-4656-8b75-4c8bb196d998 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:46.964892 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-db18f072-7b58-4656-8b75-4c8bb196d998 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:47.368316 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-db18f072-7b58-4656-8b75-4c8bb196d998 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:47.384498 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1716a4e4-adb4-40e3-9abb-b716664d3a4f tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:47.384498 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-1716a4e4-adb4-40e3-9abb-b716664d3a4f tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:47.388312 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-db18f072-7b58-4656-8b75-4c8bb196d998 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:47.394294 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-db18f072-7b58-4656-8b75-4c8bb196d998 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:47.395626 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-db18f072-7b58-4656-8b75-4c8bb196d998 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1739 microversion: 2.20 time: 0.457535 Jun 17 11:43:47.407447 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 166/335] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:43:46 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1739 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:43:47.407688 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1716a4e4-adb4-40e3-9abb-b716664d3a4f tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:47.407688 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1716a4e4-adb4-40e3-9abb-b716664d3a4f tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:47.407688 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1716a4e4-adb4-40e3-9abb-b716664d3a4f tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:47.407688 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1716a4e4-adb4-40e3-9abb-b716664d3a4f tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:47.784709 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-426be92b-9a66-4570-8675-5e1c7714836e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:47.786911 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-426be92b-9a66-4570-8675-5e1c7714836e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: a8d94a32-3230-4516-9233-fa758d450798] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:47.805560 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-426be92b-9a66-4570-8675-5e1c7714836e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:47.806013 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-426be92b-9a66-4570-8675-5e1c7714836e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:47.806826 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-426be92b-9a66-4570-8675-5e1c7714836e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:47.807270 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-426be92b-9a66-4570-8675-5e1c7714836e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:47.949737 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-426be92b-9a66-4570-8675-5e1c7714836e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:47.963160 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-426be92b-9a66-4570-8675-5e1c7714836e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798" status: 200 len: 1299 microversion: 2.1 time: 0.182332 Jun 17 11:43:47.977358 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 167/336] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:47 2022] GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798 => generated 1299 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:43:48.043418 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-1716a4e4-adb4-40e3-9abb-b716664d3a4f tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:48.064663 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-1716a4e4-adb4-40e3-9abb-b716664d3a4f tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1725 microversion: 2.1 time: 0.689100 Jun 17 11:43:48.081583 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 170/337] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:47 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1725 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:48.423324 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-430c1dcf-8107-4b92-a708-406b3d82aef4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:48.425628 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-430c1dcf-8107-4b92-a708-406b3d82aef4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:48.439231 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-430c1dcf-8107-4b92-a708-406b3d82aef4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:48.440455 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-430c1dcf-8107-4b92-a708-406b3d82aef4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:48.442312 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-430c1dcf-8107-4b92-a708-406b3d82aef4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:48.443332 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-430c1dcf-8107-4b92-a708-406b3d82aef4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:48.855058 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-430c1dcf-8107-4b92-a708-406b3d82aef4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:48.873673 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-430c1dcf-8107-4b92-a708-406b3d82aef4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:48.877983 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-430c1dcf-8107-4b92-a708-406b3d82aef4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:48.883185 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-430c1dcf-8107-4b92-a708-406b3d82aef4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1739 microversion: 2.20 time: 0.470008 Jun 17 11:43:48.884279 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 168/338] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:43:48 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1739 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:43:48.988979 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-69f1ab42-d9e3-412b-a908-eb9f009d58e8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:48.990244 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-69f1ab42-d9e3-412b-a908-eb9f009d58e8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: a8d94a32-3230-4516-9233-fa758d450798] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:49.019079 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-69f1ab42-d9e3-412b-a908-eb9f009d58e8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:49.022070 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-69f1ab42-d9e3-412b-a908-eb9f009d58e8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:49.023663 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-69f1ab42-d9e3-412b-a908-eb9f009d58e8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:49.024453 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-69f1ab42-d9e3-412b-a908-eb9f009d58e8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:49.090906 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-1e74cb3d-4e9e-4823-a113-ec7b46e5dc13 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:49.093652 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-1e74cb3d-4e9e-4823-a113-ec7b46e5dc13 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:49.111110 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1e74cb3d-4e9e-4823-a113-ec7b46e5dc13 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:49.111861 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1e74cb3d-4e9e-4823-a113-ec7b46e5dc13 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:49.113142 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1e74cb3d-4e9e-4823-a113-ec7b46e5dc13 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:49.113859 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1e74cb3d-4e9e-4823-a113-ec7b46e5dc13 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:49.573878 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-69f1ab42-d9e3-412b-a908-eb9f009d58e8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:49.587055 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-69f1ab42-d9e3-412b-a908-eb9f009d58e8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798" status: 200 len: 1367 microversion: 2.1 time: 0.606394 Jun 17 11:43:49.598420 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 171/339] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:48 2022] GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798 => generated 1367 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:49.619706 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-1e74cb3d-4e9e-4823-a113-ec7b46e5dc13 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:49.637504 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-1e74cb3d-4e9e-4823-a113-ec7b46e5dc13 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1725 microversion: 2.1 time: 0.558661 Jun 17 11:43:49.649586 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 169/340] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:49 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1725 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:49.903243 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c49c099a-2120-4031-bb0f-277d58633647 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:49.908213 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c49c099a-2120-4031-bb0f-277d58633647 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:49.924199 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c49c099a-2120-4031-bb0f-277d58633647 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:49.924199 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c49c099a-2120-4031-bb0f-277d58633647 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:49.924199 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c49c099a-2120-4031-bb0f-277d58633647 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:49.924199 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c49c099a-2120-4031-bb0f-277d58633647 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:50.289530 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c49c099a-2120-4031-bb0f-277d58633647 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:50.313630 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c49c099a-2120-4031-bb0f-277d58633647 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:50.323011 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c49c099a-2120-4031-bb0f-277d58633647 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:50.324499 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c49c099a-2120-4031-bb0f-277d58633647 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1739 microversion: 2.20 time: 0.425161 Jun 17 11:43:50.337908 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 172/341] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:43:49 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1739 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:43:50.541494 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-6831c3e2-2740-41f3-ae1e-c54f1cbe7722 req-77929ca2-24bc-431d-8754-c924a2ae7418 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8d94a32-3230-4516-9233-fa758d450798", "tag": "64e882c6-f99d-40c3-9d04-6f350ee05b98"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:43:50.568053 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-6831c3e2-2740-41f3-ae1e-c54f1cbe7722 req-77929ca2-24bc-431d-8754-c924a2ae7418 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:50.568903 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-6831c3e2-2740-41f3-ae1e-c54f1cbe7722 req-77929ca2-24bc-431d-8754-c924a2ae7418 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:50.573881 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=100 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:43:50.584334 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-6831c3e2-2740-41f3-ae1e-c54f1cbe7722 req-77929ca2-24bc-431d-8754-c924a2ae7418 service nova] Creating event network-changed:64e882c6-f99d-40c3-9d04-6f350ee05b98 for instance a8d94a32-3230-4516-9233-fa758d450798 on hv-cinder-83716 Jun 17 11:43:50.603745 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-6831c3e2-2740-41f3-ae1e-c54f1cbe7722 req-77929ca2-24bc-431d-8754-c924a2ae7418 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081587 Jun 17 11:43:50.606084 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b5d4f956-bcff-46f2-b63b-7f9f8661830a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:50.607739 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b5d4f956-bcff-46f2-b63b-7f9f8661830a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: a8d94a32-3230-4516-9233-fa758d450798] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:50.616556 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b5d4f956-bcff-46f2-b63b-7f9f8661830a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:50.619904 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 170/342] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:43:50.621060 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b5d4f956-bcff-46f2-b63b-7f9f8661830a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:50.623614 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b5d4f956-bcff-46f2-b63b-7f9f8661830a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:50.623614 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b5d4f956-bcff-46f2-b63b-7f9f8661830a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:50.679048 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c73208c9-0e7c-4d60-9a07-6e16d03c12db tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:50.709700 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c73208c9-0e7c-4d60-9a07-6e16d03c12db tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:50.735608 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c73208c9-0e7c-4d60-9a07-6e16d03c12db tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:50.736379 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c73208c9-0e7c-4d60-9a07-6e16d03c12db tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:50.737799 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c73208c9-0e7c-4d60-9a07-6e16d03c12db tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:50.738426 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c73208c9-0e7c-4d60-9a07-6e16d03c12db tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:51.116895 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b5d4f956-bcff-46f2-b63b-7f9f8661830a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:51.126426 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b5d4f956-bcff-46f2-b63b-7f9f8661830a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798" status: 200 len: 1367 microversion: 2.1 time: 0.524699 Jun 17 11:43:51.127008 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 173/343] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:50 2022] GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798 => generated 1367 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:51.167565 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c73208c9-0e7c-4d60-9a07-6e16d03c12db tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:51.178074 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c73208c9-0e7c-4d60-9a07-6e16d03c12db tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1702 microversion: 2.1 time: 0.523252 Jun 17 11:43:51.178716 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 171/344] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:50 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1702 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:51.204249 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3293e72d-1856-4814-a504-b7d2688f79d3 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:43:51.211539 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3293e72d-1856-4814-a504-b7d2688f79d3 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:51.211988 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3293e72d-1856-4814-a504-b7d2688f79d3 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:51.240572 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-3293e72d-1856-4814-a504-b7d2688f79d3 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Going to try to start instance {{(pid=124844) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 17 11:43:51.343717 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9d17dfb1-4e0c-4dc9-a22d-588f6ef12a38 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:51.344468 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9d17dfb1-4e0c-4dc9-a22d-588f6ef12a38 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:51.351621 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9d17dfb1-4e0c-4dc9-a22d-588f6ef12a38 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:51.352070 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9d17dfb1-4e0c-4dc9-a22d-588f6ef12a38 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:51.353146 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9d17dfb1-4e0c-4dc9-a22d-588f6ef12a38 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:51.353790 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9d17dfb1-4e0c-4dc9-a22d-588f6ef12a38 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:51.562896 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-3293e72d-1856-4814-a504-b7d2688f79d3 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "POST /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2/action" status: 202 len: 0 microversion: 2.1 time: 0.362436 Jun 17 11:43:51.570259 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 174/345] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jun 17 11:43:51 2022] POST /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 11:43:51.588226 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-0612d74c-f7e7-4936-b24e-c480c5ca8ef7 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:51.589795 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-0612d74c-f7e7-4936-b24e-c480c5ca8ef7 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:51.605344 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0612d74c-f7e7-4936-b24e-c480c5ca8ef7 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:51.606603 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0612d74c-f7e7-4936-b24e-c480c5ca8ef7 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:51.611996 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0612d74c-f7e7-4936-b24e-c480c5ca8ef7 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:51.614869 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0612d74c-f7e7-4936-b24e-c480c5ca8ef7 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:51.694088 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9d17dfb1-4e0c-4dc9-a22d-588f6ef12a38 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:51.722327 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9d17dfb1-4e0c-4dc9-a22d-588f6ef12a38 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:51.727476 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9d17dfb1-4e0c-4dc9-a22d-588f6ef12a38 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:51.730471 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9d17dfb1-4e0c-4dc9-a22d-588f6ef12a38 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1739 microversion: 2.20 time: 0.390987 Jun 17 11:43:51.732960 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 172/346] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:43:51 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1739 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:43:52.047086 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=2 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:43:52.082284 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-0612d74c-f7e7-4936-b24e-c480c5ca8ef7 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:52.096742 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-0612d74c-f7e7-4936-b24e-c480c5ca8ef7 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1711 microversion: 2.1 time: 0.519346 Jun 17 11:43:52.098889 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 175/347] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:51 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1711 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:52.150641 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-aa57fe20-11f9-4ed8-929d-d93d779f994d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:52.151875 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-aa57fe20-11f9-4ed8-929d-d93d779f994d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: a8d94a32-3230-4516-9233-fa758d450798] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:52.161715 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-aa57fe20-11f9-4ed8-929d-d93d779f994d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:52.163180 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-aa57fe20-11f9-4ed8-929d-d93d779f994d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:52.165913 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-aa57fe20-11f9-4ed8-929d-d93d779f994d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:52.167809 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-aa57fe20-11f9-4ed8-929d-d93d779f994d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:52.608441 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-aa57fe20-11f9-4ed8-929d-d93d779f994d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:52.637562 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-aa57fe20-11f9-4ed8-929d-d93d779f994d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798" status: 200 len: 1367 microversion: 2.1 time: 0.492242 Jun 17 11:43:52.638728 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 173/348] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:52 2022] GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798 => generated 1367 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:52.755140 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-cd33c3ed-be3e-434e-a64e-7064b580f622 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:52.758832 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-cd33c3ed-be3e-434e-a64e-7064b580f622 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:52.761132 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=12 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:43:52.771240 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cd33c3ed-be3e-434e-a64e-7064b580f622 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:52.775497 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cd33c3ed-be3e-434e-a64e-7064b580f622 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:52.778225 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cd33c3ed-be3e-434e-a64e-7064b580f622 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:52.780033 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cd33c3ed-be3e-434e-a64e-7064b580f622 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:53.117309 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ab4be86d-40e9-45c0-9d91-b32424a6e808 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:53.118587 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-ab4be86d-40e9-45c0-9d91-b32424a6e808 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:53.126150 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ab4be86d-40e9-45c0-9d91-b32424a6e808 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:53.126612 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ab4be86d-40e9-45c0-9d91-b32424a6e808 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:53.127477 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ab4be86d-40e9-45c0-9d91-b32424a6e808 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:53.127943 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ab4be86d-40e9-45c0-9d91-b32424a6e808 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:53.137900 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-cd33c3ed-be3e-434e-a64e-7064b580f622 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:53.150441 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-cd33c3ed-be3e-434e-a64e-7064b580f622 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:53.153253 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-cd33c3ed-be3e-434e-a64e-7064b580f622 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:53.166519 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-cd33c3ed-be3e-434e-a64e-7064b580f622 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1739 microversion: 2.20 time: 0.418176 Jun 17 11:43:53.171002 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 176/349] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:43:52 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1739 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:43:53.459355 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ab4be86d-40e9-45c0-9d91-b32424a6e808 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:53.477681 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-ab4be86d-40e9-45c0-9d91-b32424a6e808 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1711 microversion: 2.1 time: 0.363966 Jun 17 11:43:53.478862 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 174/350] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:53 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1711 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:43:53.657148 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-45239634-d24f-4e23-981c-b924660554c8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:53.657813 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-45239634-d24f-4e23-981c-b924660554c8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: a8d94a32-3230-4516-9233-fa758d450798] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:53.665376 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-45239634-d24f-4e23-981c-b924660554c8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:53.666121 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-45239634-d24f-4e23-981c-b924660554c8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:53.667177 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-45239634-d24f-4e23-981c-b924660554c8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:53.667637 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-45239634-d24f-4e23-981c-b924660554c8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:53.951073 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-45239634-d24f-4e23-981c-b924660554c8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:53.960670 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-45239634-d24f-4e23-981c-b924660554c8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798" status: 200 len: 1367 microversion: 2.1 time: 0.309184 Jun 17 11:43:53.961835 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 177/351] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:53 2022] GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798 => generated 1367 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:43:54.190510 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a7326635-0c79-4b07-b021-cdcb2148237f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:54.191405 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a7326635-0c79-4b07-b021-cdcb2148237f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:54.199122 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a7326635-0c79-4b07-b021-cdcb2148237f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:54.202136 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a7326635-0c79-4b07-b021-cdcb2148237f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:54.203475 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a7326635-0c79-4b07-b021-cdcb2148237f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:54.204351 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a7326635-0c79-4b07-b021-cdcb2148237f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:54.505907 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ac00d8cc-2ef5-45d3-bef0-f5feefebeeab tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:54.507065 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ac00d8cc-2ef5-45d3-bef0-f5feefebeeab tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:54.525345 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ac00d8cc-2ef5-45d3-bef0-f5feefebeeab tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:54.526820 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ac00d8cc-2ef5-45d3-bef0-f5feefebeeab tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:54.528065 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ac00d8cc-2ef5-45d3-bef0-f5feefebeeab tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:54.528763 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ac00d8cc-2ef5-45d3-bef0-f5feefebeeab tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:54.579158 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a7326635-0c79-4b07-b021-cdcb2148237f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:54.593179 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a7326635-0c79-4b07-b021-cdcb2148237f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:54.600451 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a7326635-0c79-4b07-b021-cdcb2148237f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:54.602049 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a7326635-0c79-4b07-b021-cdcb2148237f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1739 microversion: 2.20 time: 0.415668 Jun 17 11:43:54.614239 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 175/352] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:43:54 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1739 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:43:54.929348 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ac00d8cc-2ef5-45d3-bef0-f5feefebeeab tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:54.949981 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ac00d8cc-2ef5-45d3-bef0-f5feefebeeab tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1711 microversion: 2.1 time: 0.447755 Jun 17 11:43:54.950360 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 178/353] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:54 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1711 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:54.994845 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-93c194bc-ecef-42fb-ba3e-53825bde7b9e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:54.994845 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-93c194bc-ecef-42fb-ba3e-53825bde7b9e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: a8d94a32-3230-4516-9233-fa758d450798] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:55.022428 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-93c194bc-ecef-42fb-ba3e-53825bde7b9e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:55.024595 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-93c194bc-ecef-42fb-ba3e-53825bde7b9e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:55.030679 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-93c194bc-ecef-42fb-ba3e-53825bde7b9e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:55.032635 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-93c194bc-ecef-42fb-ba3e-53825bde7b9e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:55.323653 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-93c194bc-ecef-42fb-ba3e-53825bde7b9e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:55.340424 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-93c194bc-ecef-42fb-ba3e-53825bde7b9e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798" status: 200 len: 1367 microversion: 2.1 time: 0.363472 Jun 17 11:43:55.341015 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 176/354] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:54 2022] GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798 => generated 1367 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:55.628226 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e77b91e2-5344-422d-9523-93c881bd43ae tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:55.629518 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e77b91e2-5344-422d-9523-93c881bd43ae tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:55.639343 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e77b91e2-5344-422d-9523-93c881bd43ae tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:55.639912 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e77b91e2-5344-422d-9523-93c881bd43ae tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:55.640723 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e77b91e2-5344-422d-9523-93c881bd43ae tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:55.641164 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e77b91e2-5344-422d-9523-93c881bd43ae tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:55.908318 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e77b91e2-5344-422d-9523-93c881bd43ae tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:55.918114 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e77b91e2-5344-422d-9523-93c881bd43ae tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:55.922108 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e77b91e2-5344-422d-9523-93c881bd43ae tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:55.924433 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e77b91e2-5344-422d-9523-93c881bd43ae tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1739 microversion: 2.20 time: 0.301994 Jun 17 11:43:55.925501 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 179/355] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:43:55 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1739 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:43:55.974813 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-251cfd09-9ccd-4184-8808-05a404d68acc tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:55.976015 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-251cfd09-9ccd-4184-8808-05a404d68acc tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:55.985324 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-251cfd09-9ccd-4184-8808-05a404d68acc tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:55.986174 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-251cfd09-9ccd-4184-8808-05a404d68acc tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:55.988446 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-251cfd09-9ccd-4184-8808-05a404d68acc tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:55.989207 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-251cfd09-9ccd-4184-8808-05a404d68acc tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:56.369261 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-251cfd09-9ccd-4184-8808-05a404d68acc tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:56.397074 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-000650b8-932f-4b3f-b6a7-72b378eb6e29 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:56.397354 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-251cfd09-9ccd-4184-8808-05a404d68acc tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1715 microversion: 2.1 time: 0.433205 Jun 17 11:43:56.398690 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 177/356] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:55 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1715 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:56.398985 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-000650b8-932f-4b3f-b6a7-72b378eb6e29 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: a8d94a32-3230-4516-9233-fa758d450798] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:56.417768 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-000650b8-932f-4b3f-b6a7-72b378eb6e29 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:56.423981 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-000650b8-932f-4b3f-b6a7-72b378eb6e29 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:56.428939 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-000650b8-932f-4b3f-b6a7-72b378eb6e29 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:56.428939 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-000650b8-932f-4b3f-b6a7-72b378eb6e29 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:56.765980 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-000650b8-932f-4b3f-b6a7-72b378eb6e29 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:56.779480 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-000650b8-932f-4b3f-b6a7-72b378eb6e29 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798" status: 200 len: 1367 microversion: 2.1 time: 0.411284 Jun 17 11:43:56.780898 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 180/357] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:56 2022] GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798 => generated 1367 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:56.953080 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c06d6d58-4b17-472e-9078-3a9d9a94154d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:56.954043 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c06d6d58-4b17-472e-9078-3a9d9a94154d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:56.964546 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c06d6d58-4b17-472e-9078-3a9d9a94154d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:56.965659 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c06d6d58-4b17-472e-9078-3a9d9a94154d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:56.967929 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c06d6d58-4b17-472e-9078-3a9d9a94154d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:56.969016 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c06d6d58-4b17-472e-9078-3a9d9a94154d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:57.206190 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c06d6d58-4b17-472e-9078-3a9d9a94154d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:57.226416 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c06d6d58-4b17-472e-9078-3a9d9a94154d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:57.229626 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c06d6d58-4b17-472e-9078-3a9d9a94154d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:57.231176 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c06d6d58-4b17-472e-9078-3a9d9a94154d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1739 microversion: 2.20 time: 0.286712 Jun 17 11:43:57.240580 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 178/358] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:43:56 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1739 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:43:57.803943 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-bc28238d-e477-41eb-814a-46d84e3dc896 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:57.805032 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-bc28238d-e477-41eb-814a-46d84e3dc896 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: a8d94a32-3230-4516-9233-fa758d450798] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:57.848073 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bc28238d-e477-41eb-814a-46d84e3dc896 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:57.852541 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bc28238d-e477-41eb-814a-46d84e3dc896 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:57.854684 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bc28238d-e477-41eb-814a-46d84e3dc896 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:57.855710 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bc28238d-e477-41eb-814a-46d84e3dc896 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:57.902887 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-d03808d3-4f3d-43f9-a0e5-b8836ffd09a0 req-b41cef1a-b1b7-4489-ac36-13c1017a918d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8d94a32-3230-4516-9233-fa758d450798", "name": "network-vif-plugged", "status": "completed", "tag": "64e882c6-f99d-40c3-9d04-6f350ee05b98"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:43:57.927565 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-d03808d3-4f3d-43f9-a0e5-b8836ffd09a0 req-b41cef1a-b1b7-4489-ac36-13c1017a918d service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:57.928375 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-d03808d3-4f3d-43f9-a0e5-b8836ffd09a0 req-b41cef1a-b1b7-4489-ac36-13c1017a918d service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:58.010099 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-d03808d3-4f3d-43f9-a0e5-b8836ffd09a0 req-b41cef1a-b1b7-4489-ac36-13c1017a918d service nova] Creating event network-vif-plugged:64e882c6-f99d-40c3-9d04-6f350ee05b98 for instance a8d94a32-3230-4516-9233-fa758d450798 on hv-cinder-83716 Jun 17 11:43:58.023564 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-d03808d3-4f3d-43f9-a0e5-b8836ffd09a0 req-b41cef1a-b1b7-4489-ac36-13c1017a918d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123951 Jun 17 11:43:58.026031 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 179/359] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:43:58.194651 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-bc28238d-e477-41eb-814a-46d84e3dc896 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:58.214168 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-bc28238d-e477-41eb-814a-46d84e3dc896 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798" status: 200 len: 1367 microversion: 2.1 time: 0.420426 Jun 17 11:43:58.235052 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 181/360] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:57 2022] GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798 => generated 1367 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:58.277714 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-09a34499-bb0a-4696-b325-c4f7d24a2572 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:58.279764 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-09a34499-bb0a-4696-b325-c4f7d24a2572 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:58.298311 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-09a34499-bb0a-4696-b325-c4f7d24a2572 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:58.300307 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-09a34499-bb0a-4696-b325-c4f7d24a2572 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:58.307571 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-09a34499-bb0a-4696-b325-c4f7d24a2572 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:58.308520 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-09a34499-bb0a-4696-b325-c4f7d24a2572 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:58.743879 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-09a34499-bb0a-4696-b325-c4f7d24a2572 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:58.756189 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-09a34499-bb0a-4696-b325-c4f7d24a2572 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:58.760943 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-09a34499-bb0a-4696-b325-c4f7d24a2572 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:58.763021 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-09a34499-bb0a-4696-b325-c4f7d24a2572 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1739 microversion: 2.20 time: 0.508183 Jun 17 11:43:58.774512 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 180/361] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:43:58 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1739 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:43:59.245685 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b7fe8856-88d5-4acf-95b0-a4ec0b2709a7 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:59.247151 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b7fe8856-88d5-4acf-95b0-a4ec0b2709a7 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: a8d94a32-3230-4516-9233-fa758d450798] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:59.255700 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b7fe8856-88d5-4acf-95b0-a4ec0b2709a7 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:59.256799 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b7fe8856-88d5-4acf-95b0-a4ec0b2709a7 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:59.257789 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b7fe8856-88d5-4acf-95b0-a4ec0b2709a7 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:59.258392 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b7fe8856-88d5-4acf-95b0-a4ec0b2709a7 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:59.470276 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b7fe8856-88d5-4acf-95b0-a4ec0b2709a7 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:43:59.480044 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b7fe8856-88d5-4acf-95b0-a4ec0b2709a7 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798" status: 200 len: 1367 microversion: 2.1 time: 0.239658 Jun 17 11:43:59.480483 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 182/362] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:43:59 2022] GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798 => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:43:59.785397 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6df907b2-f216-4a2a-a958-ea3b086099ea tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:43:59.786841 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-6df907b2-f216-4a2a-a958-ea3b086099ea tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:43:59.803472 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6df907b2-f216-4a2a-a958-ea3b086099ea tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:59.803472 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6df907b2-f216-4a2a-a958-ea3b086099ea tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:43:59.805715 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6df907b2-f216-4a2a-a958-ea3b086099ea tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:43:59.808941 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6df907b2-f216-4a2a-a958-ea3b086099ea tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:00.074329 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6df907b2-f216-4a2a-a958-ea3b086099ea tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:00.083591 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6df907b2-f216-4a2a-a958-ea3b086099ea tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:00.085469 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6df907b2-f216-4a2a-a958-ea3b086099ea tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:00.086728 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-6df907b2-f216-4a2a-a958-ea3b086099ea tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1739 microversion: 2.20 time: 0.307592 Jun 17 11:44:00.116080 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 181/363] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:43:59 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1739 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:44:00.505337 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1e9729d1-77e8-4a8a-9a80-3ce151a49c64 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:00.506011 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-1e9729d1-77e8-4a8a-9a80-3ce151a49c64 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: a8d94a32-3230-4516-9233-fa758d450798] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:00.512870 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1e9729d1-77e8-4a8a-9a80-3ce151a49c64 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:00.513937 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1e9729d1-77e8-4a8a-9a80-3ce151a49c64 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:00.515405 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1e9729d1-77e8-4a8a-9a80-3ce151a49c64 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:00.515893 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1e9729d1-77e8-4a8a-9a80-3ce151a49c64 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:00.673930 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-1e9729d1-77e8-4a8a-9a80-3ce151a49c64 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:00.684230 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-1e9729d1-77e8-4a8a-9a80-3ce151a49c64 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798" status: 200 len: 1367 microversion: 2.1 time: 0.182715 Jun 17 11:44:00.685029 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 183/364] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:44:00 2022] GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:44:01.114093 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c6b1d41d-cabf-4976-bf08-6c99190701e8 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:01.116694 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c6b1d41d-cabf-4976-bf08-6c99190701e8 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:01.120354 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=78 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:44:01.136374 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c6b1d41d-cabf-4976-bf08-6c99190701e8 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:01.139694 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c6b1d41d-cabf-4976-bf08-6c99190701e8 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:01.141267 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c6b1d41d-cabf-4976-bf08-6c99190701e8 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:01.144308 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c6b1d41d-cabf-4976-bf08-6c99190701e8 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:01.392336 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c6b1d41d-cabf-4976-bf08-6c99190701e8 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:01.409954 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c6b1d41d-cabf-4976-bf08-6c99190701e8 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:01.412727 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c6b1d41d-cabf-4976-bf08-6c99190701e8 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:01.414275 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c6b1d41d-cabf-4976-bf08-6c99190701e8 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1739 microversion: 2.20 time: 0.309281 Jun 17 11:44:01.415093 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 182/365] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:01 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1739 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:44:01.718849 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e01ff143-bfb3-451d-ba7f-bb0ab2617e87 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:01.720406 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e01ff143-bfb3-451d-ba7f-bb0ab2617e87 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: a8d94a32-3230-4516-9233-fa758d450798] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:01.741347 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e01ff143-bfb3-451d-ba7f-bb0ab2617e87 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:01.741899 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e01ff143-bfb3-451d-ba7f-bb0ab2617e87 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:01.742776 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e01ff143-bfb3-451d-ba7f-bb0ab2617e87 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:01.743472 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e01ff143-bfb3-451d-ba7f-bb0ab2617e87 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:01.949363 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e01ff143-bfb3-451d-ba7f-bb0ab2617e87 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:01.957887 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e01ff143-bfb3-451d-ba7f-bb0ab2617e87 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798" status: 200 len: 1556 microversion: 2.1 time: 0.256274 Jun 17 11:44:01.958489 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 184/366] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:44:01 2022] GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798 => generated 1556 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:44:01.986253 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6668a9ce-bf3c-4897-b496-4b6464ac59ca tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:01.987057 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-6668a9ce-bf3c-4897-b496-4b6464ac59ca tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: a8d94a32-3230-4516-9233-fa758d450798] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:01.997685 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6668a9ce-bf3c-4897-b496-4b6464ac59ca tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:01.999056 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6668a9ce-bf3c-4897-b496-4b6464ac59ca tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:02.000406 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6668a9ce-bf3c-4897-b496-4b6464ac59ca tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:02.001142 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6668a9ce-bf3c-4897-b496-4b6464ac59ca tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:02.099583 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-6668a9ce-bf3c-4897-b496-4b6464ac59ca tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.120994 Jun 17 11:44:02.102701 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 183/367] 10.222.0.45 () {58 vars in 1274 bytes} [Fri Jun 17 11:44:01 2022] GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:44:02.439146 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f35ddcfe-8c69-4542-b5df-ebd382d8b1c5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:02.440063 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f35ddcfe-8c69-4542-b5df-ebd382d8b1c5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:02.451162 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f35ddcfe-8c69-4542-b5df-ebd382d8b1c5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:02.452049 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f35ddcfe-8c69-4542-b5df-ebd382d8b1c5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:02.453657 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f35ddcfe-8c69-4542-b5df-ebd382d8b1c5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:02.454455 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f35ddcfe-8c69-4542-b5df-ebd382d8b1c5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:02.464119 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:44:02.683072 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f35ddcfe-8c69-4542-b5df-ebd382d8b1c5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:02.696790 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f35ddcfe-8c69-4542-b5df-ebd382d8b1c5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:02.712960 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f35ddcfe-8c69-4542-b5df-ebd382d8b1c5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:02.712960 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f35ddcfe-8c69-4542-b5df-ebd382d8b1c5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1739 microversion: 2.20 time: 0.277989 Jun 17 11:44:02.713591 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 185/368] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:02 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1739 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:44:03.469761 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-05f8c330-f956-4fb1-b7fe-da5a361c8bdb req-5aa4b739-df8f-4c33-81a3-3cc28c51d6a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8d94a32-3230-4516-9233-fa758d450798", "tag": "64e882c6-f99d-40c3-9d04-6f350ee05b98"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:44:03.483070 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-05f8c330-f956-4fb1-b7fe-da5a361c8bdb req-5aa4b739-df8f-4c33-81a3-3cc28c51d6a0 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:03.483534 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-05f8c330-f956-4fb1-b7fe-da5a361c8bdb req-5aa4b739-df8f-4c33-81a3-3cc28c51d6a0 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:03.497725 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-05f8c330-f956-4fb1-b7fe-da5a361c8bdb req-5aa4b739-df8f-4c33-81a3-3cc28c51d6a0 service nova] Creating event network-changed:64e882c6-f99d-40c3-9d04-6f350ee05b98 for instance a8d94a32-3230-4516-9233-fa758d450798 on hv-cinder-83716 Jun 17 11:44:03.511139 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-05f8c330-f956-4fb1-b7fe-da5a361c8bdb req-5aa4b739-df8f-4c33-81a3-3cc28c51d6a0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047212 Jun 17 11:44:03.512791 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 184/369] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:44:03.751815 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-620d2ad7-a5fd-4c59-b24a-57566ec55c03 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:03.752800 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-620d2ad7-a5fd-4c59-b24a-57566ec55c03 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:03.766140 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-620d2ad7-a5fd-4c59-b24a-57566ec55c03 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:03.767294 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-620d2ad7-a5fd-4c59-b24a-57566ec55c03 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:03.769244 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-620d2ad7-a5fd-4c59-b24a-57566ec55c03 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:03.770310 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-620d2ad7-a5fd-4c59-b24a-57566ec55c03 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:04.150271 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-620d2ad7-a5fd-4c59-b24a-57566ec55c03 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:04.164386 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-620d2ad7-a5fd-4c59-b24a-57566ec55c03 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:04.167698 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-620d2ad7-a5fd-4c59-b24a-57566ec55c03 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:04.170044 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-620d2ad7-a5fd-4c59-b24a-57566ec55c03 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1721 microversion: 2.20 time: 0.430497 Jun 17 11:44:04.172813 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 186/370] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:03 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1721 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:44:05.199796 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-fecb98f4-f179-4670-a2ed-7d0650b13af9 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:05.200493 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-fecb98f4-f179-4670-a2ed-7d0650b13af9 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:05.215084 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fecb98f4-f179-4670-a2ed-7d0650b13af9 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:05.215578 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fecb98f4-f179-4670-a2ed-7d0650b13af9 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:05.216402 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fecb98f4-f179-4670-a2ed-7d0650b13af9 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:05.216845 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fecb98f4-f179-4670-a2ed-7d0650b13af9 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:05.384051 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-fecb98f4-f179-4670-a2ed-7d0650b13af9 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:05.393327 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-fecb98f4-f179-4670-a2ed-7d0650b13af9 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:05.394863 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-fecb98f4-f179-4670-a2ed-7d0650b13af9 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:05.396544 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-fecb98f4-f179-4670-a2ed-7d0650b13af9 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1721 microversion: 2.20 time: 0.202044 Jun 17 11:44:05.397367 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 185/371] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:05 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:44:06.425160 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-772c362b-0ec5-40f8-8317-993356180327 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:06.426452 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-772c362b-0ec5-40f8-8317-993356180327 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:06.433789 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-772c362b-0ec5-40f8-8317-993356180327 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:06.434270 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-772c362b-0ec5-40f8-8317-993356180327 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:06.435099 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-772c362b-0ec5-40f8-8317-993356180327 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:06.436134 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-772c362b-0ec5-40f8-8317-993356180327 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:06.626016 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-772c362b-0ec5-40f8-8317-993356180327 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:06.636621 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-772c362b-0ec5-40f8-8317-993356180327 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:06.638157 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-772c362b-0ec5-40f8-8317-993356180327 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:06.639559 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-772c362b-0ec5-40f8-8317-993356180327 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1721 microversion: 2.20 time: 0.220570 Jun 17 11:44:06.650847 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 187/372] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:06 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1721 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:44:07.659209 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-589cb4c8-dbe2-45a7-b056-6b0e17658cce tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:07.659958 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-589cb4c8-dbe2-45a7-b056-6b0e17658cce tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:07.667554 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-589cb4c8-dbe2-45a7-b056-6b0e17658cce tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:07.668242 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-589cb4c8-dbe2-45a7-b056-6b0e17658cce tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:07.669246 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-589cb4c8-dbe2-45a7-b056-6b0e17658cce tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:07.670389 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-589cb4c8-dbe2-45a7-b056-6b0e17658cce tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:07.770717 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-322d07c5-affc-4eb5-880d-243f012c9538 req-9ec7946f-c984-4e66-a05b-6ab96f46246e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71050501-8f84-4701-a013-bfc7a4459972", "name": "network-vif-unplugged", "status": "completed", "tag": "4f9d2fad-e808-44df-adda-539bddcec93d"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:44:07.784005 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-322d07c5-affc-4eb5-880d-243f012c9538 req-9ec7946f-c984-4e66-a05b-6ab96f46246e service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:07.784347 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-322d07c5-affc-4eb5-880d-243f012c9538 req-9ec7946f-c984-4e66-a05b-6ab96f46246e service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:07.797524 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-322d07c5-affc-4eb5-880d-243f012c9538 req-9ec7946f-c984-4e66-a05b-6ab96f46246e service nova] Creating event network-vif-unplugged:4f9d2fad-e808-44df-adda-539bddcec93d for instance 71050501-8f84-4701-a013-bfc7a4459972 on hv-cinder-83716 Jun 17 11:44:07.803681 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-322d07c5-affc-4eb5-880d-243f012c9538 req-9ec7946f-c984-4e66-a05b-6ab96f46246e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046149 Jun 17 11:44:07.804301 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 188/373] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:44:07.867863 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-589cb4c8-dbe2-45a7-b056-6b0e17658cce tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:07.877651 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-589cb4c8-dbe2-45a7-b056-6b0e17658cce tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:07.879529 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-589cb4c8-dbe2-45a7-b056-6b0e17658cce tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:07.880639 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-589cb4c8-dbe2-45a7-b056-6b0e17658cce tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1724 microversion: 2.20 time: 0.226856 Jun 17 11:44:07.881497 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 186/374] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:07 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:44:07.900546 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2d5185c8-38f0-4300-ae98-8a7b71afe557 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5826925a-d75a-439d-971f-45ff9bf4d864"}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:44:07.901999 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-2d5185c8-38f0-4300-ae98-8a7b71afe557 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:07.910158 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2d5185c8-38f0-4300-ae98-8a7b71afe557 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:07.910730 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2d5185c8-38f0-4300-ae98-8a7b71afe557 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:07.911571 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2d5185c8-38f0-4300-ae98-8a7b71afe557 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:07.912040 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2d5185c8-38f0-4300-ae98-8a7b71afe557 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:09.512307 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2d5185c8-38f0-4300-ae98-8a7b71afe557 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "POST /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.615939 Jun 17 11:44:09.519884 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 189/375] 10.222.0.45 () {62 vars in 1363 bytes} [Fri Jun 17 11:44:07 2022] POST /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972/os-volume_attachments => generated 188 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 11:44:09.657174 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-d3dcea65-c963-4fc1-b637-3fae8c29e528 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:44:09.658060 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-d3dcea65-c963-4fc1-b637-3fae8c29e528 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:09.664597 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d3dcea65-c963-4fc1-b637-3fae8c29e528 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:09.665038 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d3dcea65-c963-4fc1-b637-3fae8c29e528 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:09.665811 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d3dcea65-c963-4fc1-b637-3fae8c29e528 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:09.666254 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d3dcea65-c963-4fc1-b637-3fae8c29e528 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:10.127461 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-d3dcea65-c963-4fc1-b637-3fae8c29e528 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "POST /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972/action" status: 202 len: 0 microversion: 2.20 time: 0.475467 Jun 17 11:44:10.128396 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 187/376] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jun 17 11:44:09 2022] POST /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972/action => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 17 11:44:10.139188 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d5b1f4db-cc5d-413c-93af-2efe62e6dfb6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:10.140294 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d5b1f4db-cc5d-413c-93af-2efe62e6dfb6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:10.146774 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d5b1f4db-cc5d-413c-93af-2efe62e6dfb6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:10.147558 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d5b1f4db-cc5d-413c-93af-2efe62e6dfb6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:10.148656 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d5b1f4db-cc5d-413c-93af-2efe62e6dfb6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:10.149133 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d5b1f4db-cc5d-413c-93af-2efe62e6dfb6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:10.312637 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d5b1f4db-cc5d-413c-93af-2efe62e6dfb6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:10.322445 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d5b1f4db-cc5d-413c-93af-2efe62e6dfb6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:10.324697 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d5b1f4db-cc5d-413c-93af-2efe62e6dfb6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:10.325861 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d5b1f4db-cc5d-413c-93af-2efe62e6dfb6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1750 microversion: 2.20 time: 0.192508 Jun 17 11:44:10.327227 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 190/377] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:10 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1750 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:44:11.352621 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ac840580-be3a-4041-8632-ab9fd79a060b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:11.353485 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-ac840580-be3a-4041-8632-ab9fd79a060b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:11.372002 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ac840580-be3a-4041-8632-ab9fd79a060b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:11.372778 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ac840580-be3a-4041-8632-ab9fd79a060b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:11.374525 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ac840580-be3a-4041-8632-ab9fd79a060b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:11.375841 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ac840580-be3a-4041-8632-ab9fd79a060b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:11.384714 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:44:11.616939 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ac840580-be3a-4041-8632-ab9fd79a060b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:11.636941 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ac840580-be3a-4041-8632-ab9fd79a060b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:11.641958 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ac840580-be3a-4041-8632-ab9fd79a060b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:11.644829 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-ac840580-be3a-4041-8632-ab9fd79a060b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1750 microversion: 2.20 time: 0.298543 Jun 17 11:44:11.647043 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 188/378] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:11 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1750 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:44:12.680583 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8309d0ea-a0b8-44f9-b9bc-e992406e6d35 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:12.681205 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-8309d0ea-a0b8-44f9-b9bc-e992406e6d35 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:12.684118 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:44:12.690708 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8309d0ea-a0b8-44f9-b9bc-e992406e6d35 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:12.691167 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8309d0ea-a0b8-44f9-b9bc-e992406e6d35 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:12.692371 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8309d0ea-a0b8-44f9-b9bc-e992406e6d35 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:12.692813 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8309d0ea-a0b8-44f9-b9bc-e992406e6d35 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:12.878775 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-8309d0ea-a0b8-44f9-b9bc-e992406e6d35 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:12.888285 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-8309d0ea-a0b8-44f9-b9bc-e992406e6d35 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:12.890564 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-8309d0ea-a0b8-44f9-b9bc-e992406e6d35 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:12.894984 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-8309d0ea-a0b8-44f9-b9bc-e992406e6d35 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1750 microversion: 2.20 time: 0.218421 Jun 17 11:44:12.898266 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 191/379] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:12 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1750 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:44:13.931418 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0e26b339-04c7-4490-9fc3-7abc96a7e2a2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:13.934652 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0e26b339-04c7-4490-9fc3-7abc96a7e2a2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:13.949458 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0e26b339-04c7-4490-9fc3-7abc96a7e2a2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:13.952238 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0e26b339-04c7-4490-9fc3-7abc96a7e2a2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:13.953976 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0e26b339-04c7-4490-9fc3-7abc96a7e2a2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:13.954759 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0e26b339-04c7-4490-9fc3-7abc96a7e2a2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:14.108652 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0e26b339-04c7-4490-9fc3-7abc96a7e2a2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:14.118619 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0e26b339-04c7-4490-9fc3-7abc96a7e2a2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:14.120356 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0e26b339-04c7-4490-9fc3-7abc96a7e2a2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:14.121696 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0e26b339-04c7-4490-9fc3-7abc96a7e2a2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1750 microversion: 2.20 time: 0.203287 Jun 17 11:44:14.122359 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 189/380] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:13 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1750 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:44:15.143515 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-87819215-2cb8-47e7-b785-285100a1f856 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:15.144412 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-87819215-2cb8-47e7-b785-285100a1f856 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:15.153794 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-87819215-2cb8-47e7-b785-285100a1f856 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:15.155278 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-87819215-2cb8-47e7-b785-285100a1f856 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:15.156131 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-87819215-2cb8-47e7-b785-285100a1f856 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:15.156674 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-87819215-2cb8-47e7-b785-285100a1f856 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:15.384669 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-87819215-2cb8-47e7-b785-285100a1f856 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:15.396795 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-87819215-2cb8-47e7-b785-285100a1f856 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:15.398513 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-87819215-2cb8-47e7-b785-285100a1f856 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:15.399983 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-87819215-2cb8-47e7-b785-285100a1f856 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1752 microversion: 2.20 time: 0.261915 Jun 17 11:44:15.400790 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 192/381] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:15 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1752 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:44:16.424570 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0db39248-40be-497f-aea7-dab5b9655b5d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:16.425736 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0db39248-40be-497f-aea7-dab5b9655b5d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:16.434042 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0db39248-40be-497f-aea7-dab5b9655b5d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:16.434809 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0db39248-40be-497f-aea7-dab5b9655b5d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:16.435940 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0db39248-40be-497f-aea7-dab5b9655b5d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:16.436564 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0db39248-40be-497f-aea7-dab5b9655b5d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:16.612831 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0db39248-40be-497f-aea7-dab5b9655b5d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:16.626817 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0db39248-40be-497f-aea7-dab5b9655b5d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:16.628537 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0db39248-40be-497f-aea7-dab5b9655b5d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:16.633396 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0db39248-40be-497f-aea7-dab5b9655b5d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1752 microversion: 2.20 time: 0.209898 Jun 17 11:44:16.633396 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 190/382] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:16 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1752 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:44:17.656135 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5a8d8f4b-a1c9-4216-a30e-1fa80b27a421 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:17.658613 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-5a8d8f4b-a1c9-4216-a30e-1fa80b27a421 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:17.666910 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5a8d8f4b-a1c9-4216-a30e-1fa80b27a421 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:17.667058 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5a8d8f4b-a1c9-4216-a30e-1fa80b27a421 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:17.667897 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5a8d8f4b-a1c9-4216-a30e-1fa80b27a421 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:17.668372 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5a8d8f4b-a1c9-4216-a30e-1fa80b27a421 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:17.936586 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5a8d8f4b-a1c9-4216-a30e-1fa80b27a421 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:17.947262 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5a8d8f4b-a1c9-4216-a30e-1fa80b27a421 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:17.948975 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5a8d8f4b-a1c9-4216-a30e-1fa80b27a421 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:17.950191 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5a8d8f4b-a1c9-4216-a30e-1fa80b27a421 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1808 microversion: 2.20 time: 0.303333 Jun 17 11:44:17.950761 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 193/383] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:17 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1808 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:44:18.985368 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a721e587-67b3-49af-a07b-d8724fc2dd5d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:18.986329 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a721e587-67b3-49af-a07b-d8724fc2dd5d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:19.016594 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a721e587-67b3-49af-a07b-d8724fc2dd5d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:19.020173 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a721e587-67b3-49af-a07b-d8724fc2dd5d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:19.023855 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a721e587-67b3-49af-a07b-d8724fc2dd5d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:19.027591 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a721e587-67b3-49af-a07b-d8724fc2dd5d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:19.369350 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a721e587-67b3-49af-a07b-d8724fc2dd5d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:19.401765 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a721e587-67b3-49af-a07b-d8724fc2dd5d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:19.407355 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a721e587-67b3-49af-a07b-d8724fc2dd5d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:19.408729 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a721e587-67b3-49af-a07b-d8724fc2dd5d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1808 microversion: 2.20 time: 0.443009 Jun 17 11:44:19.409672 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 191/384] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:18 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1808 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:44:20.435204 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c6853158-0bf4-4370-a400-a940ea41a643 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:20.436639 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c6853158-0bf4-4370-a400-a940ea41a643 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:20.444510 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c6853158-0bf4-4370-a400-a940ea41a643 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:20.444961 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c6853158-0bf4-4370-a400-a940ea41a643 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:20.445752 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c6853158-0bf4-4370-a400-a940ea41a643 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:20.446192 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c6853158-0bf4-4370-a400-a940ea41a643 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:20.645284 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c6853158-0bf4-4370-a400-a940ea41a643 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:20.662495 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c6853158-0bf4-4370-a400-a940ea41a643 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:20.664297 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c6853158-0bf4-4370-a400-a940ea41a643 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:20.665664 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c6853158-0bf4-4370-a400-a940ea41a643 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1808 microversion: 2.20 time: 0.237372 Jun 17 11:44:20.674724 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 194/385] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:20 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1808 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:44:21.692709 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a9c16292-a173-4c47-b62c-4c9622ee95f6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:21.694105 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a9c16292-a173-4c47-b62c-4c9622ee95f6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:21.702550 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a9c16292-a173-4c47-b62c-4c9622ee95f6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:21.707281 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a9c16292-a173-4c47-b62c-4c9622ee95f6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:21.707281 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a9c16292-a173-4c47-b62c-4c9622ee95f6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:21.707281 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a9c16292-a173-4c47-b62c-4c9622ee95f6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:21.877055 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a9c16292-a173-4c47-b62c-4c9622ee95f6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:21.886034 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a9c16292-a173-4c47-b62c-4c9622ee95f6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:21.887577 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a9c16292-a173-4c47-b62c-4c9622ee95f6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:21.888754 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a9c16292-a173-4c47-b62c-4c9622ee95f6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1808 microversion: 2.20 time: 0.199983 Jun 17 11:44:21.889335 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 192/386] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:21 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:44:22.908491 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-74c23b8e-baaf-4d07-aa84-94ddeef77141 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:22.909426 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-74c23b8e-baaf-4d07-aa84-94ddeef77141 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:22.916829 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-74c23b8e-baaf-4d07-aa84-94ddeef77141 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:22.917200 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-74c23b8e-baaf-4d07-aa84-94ddeef77141 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:22.918032 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-74c23b8e-baaf-4d07-aa84-94ddeef77141 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:22.918476 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-74c23b8e-baaf-4d07-aa84-94ddeef77141 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:23.115775 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-74c23b8e-baaf-4d07-aa84-94ddeef77141 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:23.127789 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-74c23b8e-baaf-4d07-aa84-94ddeef77141 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:23.131282 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-74c23b8e-baaf-4d07-aa84-94ddeef77141 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:23.131282 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-74c23b8e-baaf-4d07-aa84-94ddeef77141 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1808 microversion: 2.20 time: 0.227036 Jun 17 11:44:23.131282 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 195/387] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:22 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1808 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:44:24.149917 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8fbfaae8-205a-49b7-b114-2900bda5aab4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:24.150597 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-8fbfaae8-205a-49b7-b114-2900bda5aab4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:24.158344 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8fbfaae8-205a-49b7-b114-2900bda5aab4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:24.158787 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8fbfaae8-205a-49b7-b114-2900bda5aab4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:24.159606 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8fbfaae8-205a-49b7-b114-2900bda5aab4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:24.160043 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8fbfaae8-205a-49b7-b114-2900bda5aab4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:24.325331 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-8fbfaae8-205a-49b7-b114-2900bda5aab4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:24.338990 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-8fbfaae8-205a-49b7-b114-2900bda5aab4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:24.340701 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-8fbfaae8-205a-49b7-b114-2900bda5aab4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:24.341938 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-8fbfaae8-205a-49b7-b114-2900bda5aab4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1808 microversion: 2.20 time: 0.196703 Jun 17 11:44:24.343203 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 193/388] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:24 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:44:25.367295 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f53dc36d-4a42-47da-a01b-e36cb952f943 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:25.368004 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f53dc36d-4a42-47da-a01b-e36cb952f943 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:25.376524 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f53dc36d-4a42-47da-a01b-e36cb952f943 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:25.376991 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f53dc36d-4a42-47da-a01b-e36cb952f943 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:25.380178 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f53dc36d-4a42-47da-a01b-e36cb952f943 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:25.380178 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f53dc36d-4a42-47da-a01b-e36cb952f943 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:25.613990 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f53dc36d-4a42-47da-a01b-e36cb952f943 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:25.643678 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f53dc36d-4a42-47da-a01b-e36cb952f943 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:25.651770 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f53dc36d-4a42-47da-a01b-e36cb952f943 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:25.654224 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f53dc36d-4a42-47da-a01b-e36cb952f943 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1808 microversion: 2.20 time: 0.290894 Jun 17 11:44:25.656469 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 196/389] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:25 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1808 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:44:26.684292 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f370703e-5bc0-45b2-80cf-f7f27ac46624 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:26.685097 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f370703e-5bc0-45b2-80cf-f7f27ac46624 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:26.693571 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f370703e-5bc0-45b2-80cf-f7f27ac46624 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:26.694565 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f370703e-5bc0-45b2-80cf-f7f27ac46624 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:26.695748 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f370703e-5bc0-45b2-80cf-f7f27ac46624 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:26.696540 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f370703e-5bc0-45b2-80cf-f7f27ac46624 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:26.907295 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f370703e-5bc0-45b2-80cf-f7f27ac46624 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:26.917200 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f370703e-5bc0-45b2-80cf-f7f27ac46624 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:26.918716 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f370703e-5bc0-45b2-80cf-f7f27ac46624 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:26.919927 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f370703e-5bc0-45b2-80cf-f7f27ac46624 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1808 microversion: 2.20 time: 0.240812 Jun 17 11:44:26.921035 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 194/390] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:26 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1808 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:44:27.940223 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4c140f2a-6efd-41db-95ac-8d532c9582f7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:27.940887 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4c140f2a-6efd-41db-95ac-8d532c9582f7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:27.947724 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4c140f2a-6efd-41db-95ac-8d532c9582f7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:27.950853 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4c140f2a-6efd-41db-95ac-8d532c9582f7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:27.950853 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4c140f2a-6efd-41db-95ac-8d532c9582f7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:27.950853 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4c140f2a-6efd-41db-95ac-8d532c9582f7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:28.074433 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-085328e0-f234-4fa1-a8bc-1d0c49ac32a4 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67653af2-2434-4859-b288-fce97f70ad1c"}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:44:28.076347 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-085328e0-f234-4fa1-a8bc-1d0c49ac32a4 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:28.093529 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-085328e0-f234-4fa1-a8bc-1d0c49ac32a4 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:28.097582 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-085328e0-f234-4fa1-a8bc-1d0c49ac32a4 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:28.098676 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-085328e0-f234-4fa1-a8bc-1d0c49ac32a4 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:28.099211 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-085328e0-f234-4fa1-a8bc-1d0c49ac32a4 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:28.125447 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4c140f2a-6efd-41db-95ac-8d532c9582f7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:28.135238 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4c140f2a-6efd-41db-95ac-8d532c9582f7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:28.137405 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4c140f2a-6efd-41db-95ac-8d532c9582f7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:28.138985 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4c140f2a-6efd-41db-95ac-8d532c9582f7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1808 microversion: 2.20 time: 0.203729 Jun 17 11:44:28.140703 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 197/391] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:27 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1808 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:44:29.161539 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3eef0fa4-200a-4a24-b2e2-36b059259f74 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:29.162645 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-3eef0fa4-200a-4a24-b2e2-36b059259f74 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:29.177468 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3eef0fa4-200a-4a24-b2e2-36b059259f74 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:29.177917 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3eef0fa4-200a-4a24-b2e2-36b059259f74 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:29.178696 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3eef0fa4-200a-4a24-b2e2-36b059259f74 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:29.179134 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3eef0fa4-200a-4a24-b2e2-36b059259f74 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:29.363588 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3eef0fa4-200a-4a24-b2e2-36b059259f74 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:29.375981 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3eef0fa4-200a-4a24-b2e2-36b059259f74 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:29.377523 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3eef0fa4-200a-4a24-b2e2-36b059259f74 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:29.378683 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-3eef0fa4-200a-4a24-b2e2-36b059259f74 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1808 microversion: 2.20 time: 0.222610 Jun 17 11:44:29.379242 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 198/392] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:29 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1808 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:44:30.398601 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b3620f3f-6579-461c-99a9-b93cafb85a7f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:30.399396 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b3620f3f-6579-461c-99a9-b93cafb85a7f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:30.407421 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b3620f3f-6579-461c-99a9-b93cafb85a7f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:30.407960 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b3620f3f-6579-461c-99a9-b93cafb85a7f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:30.408808 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b3620f3f-6579-461c-99a9-b93cafb85a7f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:30.409292 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b3620f3f-6579-461c-99a9-b93cafb85a7f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:30.579562 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b3620f3f-6579-461c-99a9-b93cafb85a7f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:30.581898 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:44:30.599456 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b3620f3f-6579-461c-99a9-b93cafb85a7f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:30.601280 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b3620f3f-6579-461c-99a9-b93cafb85a7f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:30.602656 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b3620f3f-6579-461c-99a9-b93cafb85a7f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1808 microversion: 2.20 time: 0.208077 Jun 17 11:44:30.603661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 199/393] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:30 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:44:31.528114 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-085328e0-f234-4fa1-a8bc-1d0c49ac32a4 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "POST /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.457392 Jun 17 11:44:31.528770 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 195/394] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jun 17 11:44:28 2022] POST /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923/os-volume_attachments => generated 194 bytes in 3460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:44:31.625336 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ebd65573-afa3-478b-a533-253dfaa49238 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:31.627594 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ebd65573-afa3-478b-a533-253dfaa49238 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:31.636631 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ebd65573-afa3-478b-a533-253dfaa49238 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:31.637585 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ebd65573-afa3-478b-a533-253dfaa49238 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:31.638743 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ebd65573-afa3-478b-a533-253dfaa49238 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:31.639191 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ebd65573-afa3-478b-a533-253dfaa49238 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:31.831705 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ebd65573-afa3-478b-a533-253dfaa49238 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:31.837800 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ebd65573-afa3-478b-a533-253dfaa49238 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:31.839335 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ebd65573-afa3-478b-a533-253dfaa49238 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:31.840585 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ebd65573-afa3-478b-a533-253dfaa49238 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1808 microversion: 2.20 time: 0.221031 Jun 17 11:44:31.841156 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 200/395] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:31 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1808 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:44:32.865713 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6a497a45-bed5-4eab-8f31-2b238bf3a27a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:32.867829 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-6a497a45-bed5-4eab-8f31-2b238bf3a27a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:32.871504 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=30 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:44:32.880451 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6a497a45-bed5-4eab-8f31-2b238bf3a27a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:32.880862 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6a497a45-bed5-4eab-8f31-2b238bf3a27a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:32.881661 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6a497a45-bed5-4eab-8f31-2b238bf3a27a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:32.882100 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6a497a45-bed5-4eab-8f31-2b238bf3a27a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:33.049587 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6a497a45-bed5-4eab-8f31-2b238bf3a27a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:33.058820 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6a497a45-bed5-4eab-8f31-2b238bf3a27a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:33.060374 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6a497a45-bed5-4eab-8f31-2b238bf3a27a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:33.062100 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-6a497a45-bed5-4eab-8f31-2b238bf3a27a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1808 microversion: 2.20 time: 0.203897 Jun 17 11:44:33.063095 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 196/396] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:32 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1808 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:44:34.083334 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2c32f037-e20c-4791-8e5f-628f7ee677f4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:34.083964 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-2c32f037-e20c-4791-8e5f-628f7ee677f4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:34.091531 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2c32f037-e20c-4791-8e5f-628f7ee677f4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:34.092123 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2c32f037-e20c-4791-8e5f-628f7ee677f4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:34.094153 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2c32f037-e20c-4791-8e5f-628f7ee677f4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:34.094795 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2c32f037-e20c-4791-8e5f-628f7ee677f4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:34.327465 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2c32f037-e20c-4791-8e5f-628f7ee677f4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:34.340395 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2c32f037-e20c-4791-8e5f-628f7ee677f4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:34.344396 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2c32f037-e20c-4791-8e5f-628f7ee677f4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:34.346592 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2c32f037-e20c-4791-8e5f-628f7ee677f4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1808 microversion: 2.20 time: 0.268391 Jun 17 11:44:34.347504 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 201/397] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:34 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1808 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:44:35.368183 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-53dd2178-695e-48cd-88fe-8e7715a93e91 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:35.368850 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-53dd2178-695e-48cd-88fe-8e7715a93e91 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:35.376315 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-53dd2178-695e-48cd-88fe-8e7715a93e91 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:35.376762 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-53dd2178-695e-48cd-88fe-8e7715a93e91 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:35.377545 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-53dd2178-695e-48cd-88fe-8e7715a93e91 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:35.377982 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-53dd2178-695e-48cd-88fe-8e7715a93e91 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:35.537327 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-53dd2178-695e-48cd-88fe-8e7715a93e91 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:35.548360 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-53dd2178-695e-48cd-88fe-8e7715a93e91 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:35.550125 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-53dd2178-695e-48cd-88fe-8e7715a93e91 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:35.551475 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-53dd2178-695e-48cd-88fe-8e7715a93e91 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1808 microversion: 2.20 time: 0.188098 Jun 17 11:44:35.552127 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 197/398] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:35 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:44:36.573555 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-28fd5986-3a02-4c10-b611-6ce48e5fe76a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:36.574118 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-28fd5986-3a02-4c10-b611-6ce48e5fe76a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:36.581714 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-28fd5986-3a02-4c10-b611-6ce48e5fe76a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:36.582167 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-28fd5986-3a02-4c10-b611-6ce48e5fe76a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:36.582948 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-28fd5986-3a02-4c10-b611-6ce48e5fe76a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:36.583406 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-28fd5986-3a02-4c10-b611-6ce48e5fe76a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:36.752026 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-28fd5986-3a02-4c10-b611-6ce48e5fe76a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:36.761868 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-28fd5986-3a02-4c10-b611-6ce48e5fe76a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:36.763393 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-28fd5986-3a02-4c10-b611-6ce48e5fe76a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:36.764801 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-28fd5986-3a02-4c10-b611-6ce48e5fe76a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1808 microversion: 2.20 time: 0.195447 Jun 17 11:44:36.765574 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 202/399] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:36 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:44:37.785306 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-89d0b075-9a2e-4d25-ab44-c3e7349c09dd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:37.786114 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-89d0b075-9a2e-4d25-ab44-c3e7349c09dd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:37.793388 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-89d0b075-9a2e-4d25-ab44-c3e7349c09dd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:37.793838 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-89d0b075-9a2e-4d25-ab44-c3e7349c09dd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:37.794615 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-89d0b075-9a2e-4d25-ab44-c3e7349c09dd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:37.795044 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-89d0b075-9a2e-4d25-ab44-c3e7349c09dd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:38.009606 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-89d0b075-9a2e-4d25-ab44-c3e7349c09dd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:38.034086 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-89d0b075-9a2e-4d25-ab44-c3e7349c09dd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:38.034086 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-89d0b075-9a2e-4d25-ab44-c3e7349c09dd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:38.035043 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-89d0b075-9a2e-4d25-ab44-c3e7349c09dd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1808 microversion: 2.20 time: 0.253295 Jun 17 11:44:38.036490 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 198/400] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:37 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1808 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:44:39.057940 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-04a15167-d7c2-43df-bd4e-6002c44661da tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:39.058639 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-04a15167-d7c2-43df-bd4e-6002c44661da tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:39.066931 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-04a15167-d7c2-43df-bd4e-6002c44661da tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:39.067413 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-04a15167-d7c2-43df-bd4e-6002c44661da tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:39.068201 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-04a15167-d7c2-43df-bd4e-6002c44661da tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:39.068649 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-04a15167-d7c2-43df-bd4e-6002c44661da tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:39.235949 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-04a15167-d7c2-43df-bd4e-6002c44661da tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:39.247984 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-04a15167-d7c2-43df-bd4e-6002c44661da tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:39.249579 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-04a15167-d7c2-43df-bd4e-6002c44661da tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:39.250901 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-04a15167-d7c2-43df-bd4e-6002c44661da tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1808 microversion: 2.20 time: 0.197116 Jun 17 11:44:39.251518 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 203/401] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:39 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:44:40.272445 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9d35e91d-89bb-426e-844b-cdcf4269b21a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:40.273074 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9d35e91d-89bb-426e-844b-cdcf4269b21a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:40.281484 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9d35e91d-89bb-426e-844b-cdcf4269b21a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:40.282522 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9d35e91d-89bb-426e-844b-cdcf4269b21a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:40.283653 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9d35e91d-89bb-426e-844b-cdcf4269b21a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:40.284386 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9d35e91d-89bb-426e-844b-cdcf4269b21a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:40.443539 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9d35e91d-89bb-426e-844b-cdcf4269b21a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:40.452878 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9d35e91d-89bb-426e-844b-cdcf4269b21a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:40.454410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9d35e91d-89bb-426e-844b-cdcf4269b21a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:40.455614 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9d35e91d-89bb-426e-844b-cdcf4269b21a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1808 microversion: 2.20 time: 0.187091 Jun 17 11:44:40.456190 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 199/402] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:40 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:44:41.476002 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-156984e5-e9ae-4e2a-bd6a-5ab0abaa4bef tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:41.476851 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-156984e5-e9ae-4e2a-bd6a-5ab0abaa4bef tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:41.484350 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-156984e5-e9ae-4e2a-bd6a-5ab0abaa4bef tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:41.491803 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-156984e5-e9ae-4e2a-bd6a-5ab0abaa4bef tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:41.491803 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-156984e5-e9ae-4e2a-bd6a-5ab0abaa4bef tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:41.491803 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-156984e5-e9ae-4e2a-bd6a-5ab0abaa4bef tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:41.657659 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-156984e5-e9ae-4e2a-bd6a-5ab0abaa4bef tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:41.667099 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-156984e5-e9ae-4e2a-bd6a-5ab0abaa4bef tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:41.668663 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-156984e5-e9ae-4e2a-bd6a-5ab0abaa4bef tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:41.669867 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-156984e5-e9ae-4e2a-bd6a-5ab0abaa4bef tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1808 microversion: 2.20 time: 0.198190 Jun 17 11:44:41.670476 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 204/403] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:41 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:44:41.966594 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-9a86ca83-a03b-49b6-8549-aea04b7f1970 req-32551fef-8a05-40f5-815e-97b5cfa3e4cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71050501-8f84-4701-a013-bfc7a4459972", "name": "network-vif-plugged", "status": "completed", "tag": "4f9d2fad-e808-44df-adda-539bddcec93d"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:44:41.984844 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-9a86ca83-a03b-49b6-8549-aea04b7f1970 req-32551fef-8a05-40f5-815e-97b5cfa3e4cd service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:41.985645 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-9a86ca83-a03b-49b6-8549-aea04b7f1970 req-32551fef-8a05-40f5-815e-97b5cfa3e4cd service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:41.993060 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:44:42.007893 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-9a86ca83-a03b-49b6-8549-aea04b7f1970 req-32551fef-8a05-40f5-815e-97b5cfa3e4cd service nova] Creating event network-vif-plugged:4f9d2fad-e808-44df-adda-539bddcec93d for instance 71050501-8f84-4701-a013-bfc7a4459972 on hv-cinder-83716 Jun 17 11:44:42.015829 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-9a86ca83-a03b-49b6-8549-aea04b7f1970 req-32551fef-8a05-40f5-815e-97b5cfa3e4cd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055362 Jun 17 11:44:42.016689 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 200/404] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:44:42.691798 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-cd05ccec-d804-4483-a9d4-3eef47aab7c6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:42.692652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-cd05ccec-d804-4483-a9d4-3eef47aab7c6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:42.699677 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cd05ccec-d804-4483-a9d4-3eef47aab7c6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:42.700125 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cd05ccec-d804-4483-a9d4-3eef47aab7c6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:42.700939 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cd05ccec-d804-4483-a9d4-3eef47aab7c6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:42.701374 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cd05ccec-d804-4483-a9d4-3eef47aab7c6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:42.896921 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-cd05ccec-d804-4483-a9d4-3eef47aab7c6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:42.910716 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-cd05ccec-d804-4483-a9d4-3eef47aab7c6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:42.913583 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-cd05ccec-d804-4483-a9d4-3eef47aab7c6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:42.916739 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-cd05ccec-d804-4483-a9d4-3eef47aab7c6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1808 microversion: 2.20 time: 0.230957 Jun 17 11:44:42.917513 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 205/405] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:42 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1808 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:44:43.941758 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ebaefd22-8721-4a95-a117-47eff560afcb tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:43.942852 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-ebaefd22-8721-4a95-a117-47eff560afcb tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:43.951663 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ebaefd22-8721-4a95-a117-47eff560afcb tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:43.952113 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ebaefd22-8721-4a95-a117-47eff560afcb tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:43.953095 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ebaefd22-8721-4a95-a117-47eff560afcb tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:43.953521 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ebaefd22-8721-4a95-a117-47eff560afcb tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:44.139088 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ebaefd22-8721-4a95-a117-47eff560afcb tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:44.148863 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ebaefd22-8721-4a95-a117-47eff560afcb tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:44.150432 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ebaefd22-8721-4a95-a117-47eff560afcb tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:44.151647 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-ebaefd22-8721-4a95-a117-47eff560afcb tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1808 microversion: 2.20 time: 0.215865 Jun 17 11:44:44.152628 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 201/406] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:43 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:44:44.605402 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-251537b8-4602-498a-9196-b1ecfaedb938 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:44:44.606819 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-251537b8-4602-498a-9196-b1ecfaedb938 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:44.616649 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-251537b8-4602-498a-9196-b1ecfaedb938 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:44.618012 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-251537b8-4602-498a-9196-b1ecfaedb938 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:44.619036 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-251537b8-4602-498a-9196-b1ecfaedb938 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:44.619746 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-251537b8-4602-498a-9196-b1ecfaedb938 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:44.648934 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-251537b8-4602-498a-9196-b1ecfaedb938 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lazy-loading 'flavor' on Instance uuid 9a27dd59-4638-430d-a484-d38ed6fcf923 {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:44:45.172229 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-251537b8-4602-498a-9196-b1ecfaedb938 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "POST /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923/action" status: 200 len: 32 microversion: 2.1 time: 0.565918 Jun 17 11:44:45.173484 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 206/407] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jun 17 11:44:44 2022] POST /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923/action => generated 32 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 17 11:44:45.174785 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b38d57ad-c160-41de-8015-2c2afcb446d0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:45.175449 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b38d57ad-c160-41de-8015-2c2afcb446d0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:45.186309 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d46c86b8-8e9c-4e2e-9185-59f28456c16e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:45.187162 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d46c86b8-8e9c-4e2e-9185-59f28456c16e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:45.187291 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b38d57ad-c160-41de-8015-2c2afcb446d0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:45.188050 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b38d57ad-c160-41de-8015-2c2afcb446d0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:45.189345 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b38d57ad-c160-41de-8015-2c2afcb446d0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:45.190191 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b38d57ad-c160-41de-8015-2c2afcb446d0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:45.195418 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d46c86b8-8e9c-4e2e-9185-59f28456c16e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:45.195878 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d46c86b8-8e9c-4e2e-9185-59f28456c16e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:45.196644 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d46c86b8-8e9c-4e2e-9185-59f28456c16e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:45.197257 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d46c86b8-8e9c-4e2e-9185-59f28456c16e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:45.435966 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d46c86b8-8e9c-4e2e-9185-59f28456c16e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:45.438135 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b38d57ad-c160-41de-8015-2c2afcb446d0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:45.449362 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b38d57ad-c160-41de-8015-2c2afcb446d0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:45.451337 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b38d57ad-c160-41de-8015-2c2afcb446d0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:45.454119 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b38d57ad-c160-41de-8015-2c2afcb446d0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1808 microversion: 2.20 time: 0.285774 Jun 17 11:44:45.455335 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 202/408] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:45 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1808 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:44:45.455947 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d46c86b8-8e9c-4e2e-9185-59f28456c16e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1734 microversion: 2.1 time: 0.274785 Jun 17 11:44:45.457261 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 207/409] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:44:45 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1734 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:44:46.483071 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a63b9484-950b-4f0e-93f3-2c7e8be06da2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:46.489770 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a63b9484-950b-4f0e-93f3-2c7e8be06da2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:46.490004 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-81557986-71f4-4caa-9319-d91315e80c03 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:46.490004 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-81557986-71f4-4caa-9319-d91315e80c03 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:46.492312 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=34 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:44:46.492904 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a63b9484-950b-4f0e-93f3-2c7e8be06da2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:46.493484 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a63b9484-950b-4f0e-93f3-2c7e8be06da2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:46.494424 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a63b9484-950b-4f0e-93f3-2c7e8be06da2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:46.495225 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a63b9484-950b-4f0e-93f3-2c7e8be06da2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:46.496651 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-81557986-71f4-4caa-9319-d91315e80c03 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:46.497104 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-81557986-71f4-4caa-9319-d91315e80c03 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:46.497891 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-81557986-71f4-4caa-9319-d91315e80c03 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:46.498328 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-81557986-71f4-4caa-9319-d91315e80c03 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:46.778552 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-81557986-71f4-4caa-9319-d91315e80c03 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:46.799489 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a63b9484-950b-4f0e-93f3-2c7e8be06da2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:46.799770 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-81557986-71f4-4caa-9319-d91315e80c03 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:46.799770 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-81557986-71f4-4caa-9319-d91315e80c03 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:46.799770 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-81557986-71f4-4caa-9319-d91315e80c03 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1808 microversion: 2.20 time: 0.311396 Jun 17 11:44:46.800029 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 208/410] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:46 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1808 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:44:46.802052 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a63b9484-950b-4f0e-93f3-2c7e8be06da2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1734 microversion: 2.1 time: 0.322852 Jun 17 11:44:46.802740 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 203/411] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:44:46 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1734 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:44:47.818645 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-00e48e58-dc64-41a2-9cc0-00b2d215b4cf tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:47.819513 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-00e48e58-dc64-41a2-9cc0-00b2d215b4cf tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:47.823800 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9b8cc92d-9806-4d09-8e74-d1513d2a6509 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:47.824576 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9b8cc92d-9806-4d09-8e74-d1513d2a6509 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:47.829448 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-00e48e58-dc64-41a2-9cc0-00b2d215b4cf tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:47.829987 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-00e48e58-dc64-41a2-9cc0-00b2d215b4cf tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:47.830878 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-00e48e58-dc64-41a2-9cc0-00b2d215b4cf tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:47.831404 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-00e48e58-dc64-41a2-9cc0-00b2d215b4cf tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:47.833845 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9b8cc92d-9806-4d09-8e74-d1513d2a6509 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:47.834491 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9b8cc92d-9806-4d09-8e74-d1513d2a6509 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:47.835569 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9b8cc92d-9806-4d09-8e74-d1513d2a6509 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:47.836123 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9b8cc92d-9806-4d09-8e74-d1513d2a6509 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:48.078439 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9b8cc92d-9806-4d09-8e74-d1513d2a6509 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:48.096335 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-00e48e58-dc64-41a2-9cc0-00b2d215b4cf tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:48.113444 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-00e48e58-dc64-41a2-9cc0-00b2d215b4cf tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:48.114100 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9b8cc92d-9806-4d09-8e74-d1513d2a6509 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1734 microversion: 2.1 time: 0.274773 Jun 17 11:44:48.115448 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 204/412] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:44:47 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1734 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:44:48.129357 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-00e48e58-dc64-41a2-9cc0-00b2d215b4cf tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:48.129357 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-00e48e58-dc64-41a2-9cc0-00b2d215b4cf tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1808 microversion: 2.20 time: 0.306108 Jun 17 11:44:48.129357 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 209/413] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:47 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1808 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:44:49.142462 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d820b2b8-87f9-48af-8bbb-d2af68e0c4de tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:49.143499 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d820b2b8-87f9-48af-8bbb-d2af68e0c4de tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:49.144293 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b03feb6b-4339-4609-9a18-65cb0551e5ab tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:49.145445 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b03feb6b-4339-4609-9a18-65cb0551e5ab tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:49.154465 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d820b2b8-87f9-48af-8bbb-d2af68e0c4de tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:49.155243 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d820b2b8-87f9-48af-8bbb-d2af68e0c4de tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:49.164154 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d820b2b8-87f9-48af-8bbb-d2af68e0c4de tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:49.164154 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d820b2b8-87f9-48af-8bbb-d2af68e0c4de tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:49.164696 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b03feb6b-4339-4609-9a18-65cb0551e5ab tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:49.164696 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b03feb6b-4339-4609-9a18-65cb0551e5ab tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:49.164696 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b03feb6b-4339-4609-9a18-65cb0551e5ab tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:49.164696 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b03feb6b-4339-4609-9a18-65cb0551e5ab tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:49.430326 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d820b2b8-87f9-48af-8bbb-d2af68e0c4de tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:49.438737 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b03feb6b-4339-4609-9a18-65cb0551e5ab tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:49.450664 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b03feb6b-4339-4609-9a18-65cb0551e5ab tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:49.454673 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b03feb6b-4339-4609-9a18-65cb0551e5ab tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:49.457047 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d820b2b8-87f9-48af-8bbb-d2af68e0c4de tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1734 microversion: 2.1 time: 0.323020 Jun 17 11:44:49.457676 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 210/414] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:44:49 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1734 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:44:49.458593 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b03feb6b-4339-4609-9a18-65cb0551e5ab tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1795 microversion: 2.20 time: 0.321319 Jun 17 11:44:49.472694 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 205/415] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:44:49 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1795 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:44:50.484126 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ee85b97a-c43a-4dc2-b9a0-8275f057a500 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:50.486412 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ee85b97a-c43a-4dc2-b9a0-8275f057a500 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:50.503832 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ee85b97a-c43a-4dc2-b9a0-8275f057a500 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:50.505198 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ee85b97a-c43a-4dc2-b9a0-8275f057a500 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:50.512850 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ee85b97a-c43a-4dc2-b9a0-8275f057a500 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:50.513328 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ee85b97a-c43a-4dc2-b9a0-8275f057a500 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:50.811914 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ee85b97a-c43a-4dc2-b9a0-8275f057a500 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:50.825865 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ee85b97a-c43a-4dc2-b9a0-8275f057a500 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1734 microversion: 2.1 time: 0.353163 Jun 17 11:44:50.826639 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 211/416] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:44:50 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1734 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:44:51.862073 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2d8e101a-dbe9-410a-b792-62059aa7d6cc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:51.863964 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2d8e101a-dbe9-410a-b792-62059aa7d6cc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:51.877152 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2d8e101a-dbe9-410a-b792-62059aa7d6cc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:51.877746 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2d8e101a-dbe9-410a-b792-62059aa7d6cc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:51.878687 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2d8e101a-dbe9-410a-b792-62059aa7d6cc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:51.879304 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2d8e101a-dbe9-410a-b792-62059aa7d6cc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:52.083326 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2d8e101a-dbe9-410a-b792-62059aa7d6cc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:52.097822 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2d8e101a-dbe9-410a-b792-62059aa7d6cc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1734 microversion: 2.1 time: 0.244934 Jun 17 11:44:52.100132 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 206/417] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:44:51 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1734 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:44:53.117535 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-bc87867f-0be9-4d7b-a394-1baa4915c7d2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:53.118667 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-bc87867f-0be9-4d7b-a394-1baa4915c7d2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:53.126620 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bc87867f-0be9-4d7b-a394-1baa4915c7d2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:53.127079 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bc87867f-0be9-4d7b-a394-1baa4915c7d2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:53.128182 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bc87867f-0be9-4d7b-a394-1baa4915c7d2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:53.133863 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bc87867f-0be9-4d7b-a394-1baa4915c7d2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:53.394186 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-bc87867f-0be9-4d7b-a394-1baa4915c7d2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:53.420574 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-bc87867f-0be9-4d7b-a394-1baa4915c7d2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1734 microversion: 2.1 time: 0.304162 Jun 17 11:44:53.422197 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 212/418] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:44:53 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1734 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:44:54.445773 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-302d6cbb-c739-4aa3-85c8-cf795506c2b1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:54.455855 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-302d6cbb-c739-4aa3-85c8-cf795506c2b1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:54.455855 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-302d6cbb-c739-4aa3-85c8-cf795506c2b1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:54.455855 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-302d6cbb-c739-4aa3-85c8-cf795506c2b1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:54.455855 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-302d6cbb-c739-4aa3-85c8-cf795506c2b1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:54.456552 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-302d6cbb-c739-4aa3-85c8-cf795506c2b1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:54.834670 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-302d6cbb-c739-4aa3-85c8-cf795506c2b1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:54.852708 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-302d6cbb-c739-4aa3-85c8-cf795506c2b1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1734 microversion: 2.1 time: 0.405984 Jun 17 11:44:54.855219 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 207/419] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:44:54 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1734 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:44:55.123986 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-26f74589-7f0a-41c0-bb96-4d4ad2a104cd tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:55.125472 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-26f74589-7f0a-41c0-bb96-4d4ad2a104cd tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:55.144233 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-26f74589-7f0a-41c0-bb96-4d4ad2a104cd tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:55.145010 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-26f74589-7f0a-41c0-bb96-4d4ad2a104cd tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:55.154131 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-26f74589-7f0a-41c0-bb96-4d4ad2a104cd tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:55.155571 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-26f74589-7f0a-41c0-bb96-4d4ad2a104cd tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:55.414212 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-26f74589-7f0a-41c0-bb96-4d4ad2a104cd tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lazy-loading 'services' on Instance uuid b8cd69a4-437d-4db2-bd02-b485b06773e2 {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:44:55.800420 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:44:55.884691 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0b600f9f-9739-42d9-9f0e-1532a8b48c3f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:55.885567 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0b600f9f-9739-42d9-9f0e-1532a8b48c3f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:55.898311 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0b600f9f-9739-42d9-9f0e-1532a8b48c3f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:55.898766 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0b600f9f-9739-42d9-9f0e-1532a8b48c3f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:55.899623 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0b600f9f-9739-42d9-9f0e-1532a8b48c3f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:55.900067 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0b600f9f-9739-42d9-9f0e-1532a8b48c3f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:55.938490 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-26f74589-7f0a-41c0-bb96-4d4ad2a104cd tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2/os-volume_attachments/8dfbbf1c-e387-4897-9008-2defe1da3e10" status: 202 len: 0 microversion: 2.1 time: 0.818072 Jun 17 11:44:55.941648 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 213/420] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Jun 17 11:44:55 2022] DELETE /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2/os-volume_attachments/8dfbbf1c-e387-4897-9008-2defe1da3e10 => generated 0 bytes in 827 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 11:44:56.414381 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0b600f9f-9739-42d9-9f0e-1532a8b48c3f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:56.431629 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0b600f9f-9739-42d9-9f0e-1532a8b48c3f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1734 microversion: 2.1 time: 0.550825 Jun 17 11:44:56.450791 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 208/421] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:44:55 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1734 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:44:57.455826 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-638eb11a-43fe-430a-979f-a042fbd2b8e3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:57.457150 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-638eb11a-43fe-430a-979f-a042fbd2b8e3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:57.475800 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-638eb11a-43fe-430a-979f-a042fbd2b8e3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:57.476490 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-638eb11a-43fe-430a-979f-a042fbd2b8e3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:57.477484 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-638eb11a-43fe-430a-979f-a042fbd2b8e3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:57.478104 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-638eb11a-43fe-430a-979f-a042fbd2b8e3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:57.695831 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-638eb11a-43fe-430a-979f-a042fbd2b8e3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:57.714502 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-638eb11a-43fe-430a-979f-a042fbd2b8e3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1734 microversion: 2.1 time: 0.263685 Jun 17 11:44:57.718725 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 214/422] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:44:57 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1734 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:44:58.321444 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-024013cf-1285-42d5-bfaa-b0f92d952c45 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:44:58.350029 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-024013cf-1285-42d5-bfaa-b0f92d952c45 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:58.356020 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-024013cf-1285-42d5-bfaa-b0f92d952c45 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:58.550669 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-024013cf-1285-42d5-bfaa-b0f92d952c45 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Going to try to stop instance {{(pid=124845) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 17 11:44:58.759492 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d779b2a7-ae02-4b32-a583-723fae6725a3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:58.766936 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d779b2a7-ae02-4b32-a583-723fae6725a3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:58.786745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d779b2a7-ae02-4b32-a583-723fae6725a3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:58.788000 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d779b2a7-ae02-4b32-a583-723fae6725a3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:58.796892 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d779b2a7-ae02-4b32-a583-723fae6725a3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:58.796892 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d779b2a7-ae02-4b32-a583-723fae6725a3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:58.881775 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-024013cf-1285-42d5-bfaa-b0f92d952c45 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "POST /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2/action" status: 202 len: 0 microversion: 2.1 time: 0.567998 Jun 17 11:44:58.885336 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 209/423] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jun 17 11:44:58 2022] POST /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2/action => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 11:44:58.902088 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6f971d5a-a755-41b0-b393-f68936dfd528 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:58.902947 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-6f971d5a-a755-41b0-b393-f68936dfd528 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: a8d94a32-3230-4516-9233-fa758d450798] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:58.923787 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6f971d5a-a755-41b0-b393-f68936dfd528 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:58.924569 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6f971d5a-a755-41b0-b393-f68936dfd528 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:58.925474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6f971d5a-a755-41b0-b393-f68936dfd528 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:58.926150 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6f971d5a-a755-41b0-b393-f68936dfd528 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:58.979641 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-6f971d5a-a755-41b0-b393-f68936dfd528 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798/ips" status: 200 len: 149 microversion: 2.1 time: 0.095403 Jun 17 11:44:58.981449 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 210/424] 10.222.0.45 () {58 vars in 1247 bytes} [Fri Jun 17 11:44:58 2022] GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798/ips => generated 149 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:44:58.996743 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-1977f9de-285a-43c8-9ccb-5e869c8a639f tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:58.997814 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-1977f9de-285a-43c8-9ccb-5e869c8a639f tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:59.015948 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1977f9de-285a-43c8-9ccb-5e869c8a639f tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:59.016266 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1977f9de-285a-43c8-9ccb-5e869c8a639f tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:59.017189 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1977f9de-285a-43c8-9ccb-5e869c8a639f tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:59.017978 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1977f9de-285a-43c8-9ccb-5e869c8a639f tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:59.091002 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d779b2a7-ae02-4b32-a583-723fae6725a3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:59.110599 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d779b2a7-ae02-4b32-a583-723fae6725a3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1734 microversion: 2.1 time: 0.364554 Jun 17 11:44:59.111452 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 215/425] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:44:58 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1734 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:44:59.135916 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-72550889-5f67-4594-a22d-c08fef3a302f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41bb0945-b2db-47bd-aaa1-dc0fdab9c83e"}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:44:59.145576 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-72550889-5f67-4594-a22d-c08fef3a302f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: a8d94a32-3230-4516-9233-fa758d450798] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:59.155316 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-72550889-5f67-4594-a22d-c08fef3a302f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:59.160367 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-72550889-5f67-4594-a22d-c08fef3a302f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:59.161179 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-72550889-5f67-4594-a22d-c08fef3a302f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:59.162009 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-72550889-5f67-4594-a22d-c08fef3a302f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:59.300265 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-1977f9de-285a-43c8-9ccb-5e869c8a639f tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:44:59.311175 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-1977f9de-285a-43c8-9ccb-5e869c8a639f tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1679 microversion: 2.1 time: 0.328628 Jun 17 11:44:59.313884 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 211/426] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:44:58 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1679 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:44:59.347701 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-72550889-5f67-4594-a22d-c08fef3a302f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] HTTP exception thrown: Invalid volume: volume 41bb0945-b2db-47bd-aaa1-dc0fdab9c83e is already attached to instances: be48aa4e-115e-4d58-8940-f722120f4664 Jun 17 11:44:59.350204 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-72550889-5f67-4594-a22d-c08fef3a302f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Request method failure captured: Jun 17 11:44:59.350204 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: request: POST /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798/os-volume_attachments HTTP/1.1 Jun 17 11:44:59.350204 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept: application/json Jun 17 11:44:59.350204 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jun 17 11:44:59.350204 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Connection: close Jun 17 11:44:59.350204 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Length: 74 Jun 17 11:44:59.350204 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jun 17 11:44:59.350204 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Host: 10.222.0.45 Jun 17 11:44:59.350204 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jun 17 11:44:59.350204 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jun 17 11:44:59.350204 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABirGhbQZN58Mc4zyhUveG-Q-SFsZYiqbX0gxyltnPVCjSfEYNyfXfhfVCx5KdbK5qhE4EnaiOrUEMOKAhCCD_-tiKGRwJFUZvlEPvpBXY3_SY-UVihK6NaeFSNbrNpsHezSsj02ro8zcS2-cKoHlRfS3nCqLWBYJ5x0JyaHmYJlkw7b68 Jun 17 11:44:59.350204 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jun 17 11:44:59.350204 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jun 17 11:44:59.350204 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jun 17 11:44:59.350204 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jun 17 11:44:59.350204 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jun 17 11:44:59.350204 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jun 17 11:44:59.350204 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Id: c58cf63264414f30a98161f6027daad0 Jun 17 11:44:59.350204 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:44:59.350204 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Role: member,reader Jun 17 11:44:59.350204 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Roles: member,reader Jun 17 11:44:59.351809 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c58cf63264414f30a98161f6027daad0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c58cf63264414f30a98161f6027daad0", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c58cf63264414f30a98161f6027daad0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c58cf63264414f30a98161f6027daad0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:44:59.351809 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:44:59.351809 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Id: c58cf63264414f30a98161f6027daad0 Jun 17 11:44:59.351809 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:44:59.351809 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User: tempest-AttachVolumeNegativeTest-1942846496-project Jun 17 11:44:59.351809 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jun 17 11:44:59.351809 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jun 17 11:44:59.351809 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Id: 2e58eacbbb9e41fdbbb13f5b39be782a Jun 17 11:44:59.351809 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-AttachVolumeNegativeTest-1942846496-project Jun 17 11:44:59.351809 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Jun 17 11:44:59.351809 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {"volumeAttachment": {"volumeId": "41bb0945-b2db-47bd-aaa1-dc0fdab9c83e"}} Jun 17 11:44:59.351809 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: method: > Jun 17 11:44:59.352734 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: exception: Invalid volume: volume 41bb0945-b2db-47bd-aaa1-dc0fdab9c83e is already attached to instances: be48aa4e-115e-4d58-8940-f722120f4664 Jun 17 11:44:59.352734 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: action_args: {'server_id': 'a8d94a32-3230-4516-9233-fa758d450798', 'body': {'volumeAttachment': {'volumeId': '41bb0945-b2db-47bd-aaa1-dc0fdab9c83e'}}} Jun 17 11:44:59.352734 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:44:59.352734 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:44:59.352734 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 17 11:44:59.352734 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 17 11:44:59.352734 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 11:44:59.352734 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 11:44:59.352734 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 11:44:59.352734 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 11:44:59.352734 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 17 11:44:59.352734 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 17 11:44:59.352734 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 17 11:44:59.352734 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 17 11:44:59.352734 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 41bb0945-b2db-47bd-aaa1-dc0fdab9c83e is already attached to instances: be48aa4e-115e-4d58-8940-f722120f4664 Jun 17 11:44:59.352734 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:44:59.352734 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:44:59.352734 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:44:59.352734 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:44:59.354125 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:44:59.354125 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:44:59.354125 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:44:59.354125 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:44:59.354125 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:44:59.354125 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:44:59.354125 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 11:44:59.354125 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 11:44:59.354125 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 11:44:59.354125 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 11:44:59.354125 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 11:44:59.354125 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 11:44:59.354125 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 17 11:44:59.354125 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 11:44:59.354125 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 41bb0945-b2db-47bd-aaa1-dc0fdab9c83e is already attached to instances: be48aa4e-115e-4d58-8940-f722120f4664 Jun 17 11:44:59.354125 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:44:59.354125 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:44:59.354125 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:44:59.354125 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:44:59.354125 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:44:59.355539 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:44:59.355539 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:44:59.355539 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:44:59.355539 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 41bb0945-b2db-47bd-aaa1-dc0fdab9c83e is already attached to instances: be48aa4e-115e-4d58-8940-f722120f4664 Jun 17 11:44:59.355539 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:44:59.355539 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-72550889-5f67-4594-a22d-c08fef3a302f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Returning 400 to user: Invalid volume: volume 41bb0945-b2db-47bd-aaa1-dc0fdab9c83e is already attached to instances: be48aa4e-115e-4d58-8940-f722120f4664 {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:44:59.356985 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-72550889-5f67-4594-a22d-c08fef3a302f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "POST /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.238914 Jun 17 11:44:59.357650 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 216/427] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jun 17 11:44:59 2022] POST /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798/os-volume_attachments => generated 174 bytes in 245 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 11:44:59.367271 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-309efcfb-8157-4086-8977-8545eb3e1854 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:59.367915 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-309efcfb-8157-4086-8977-8545eb3e1854 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: a8d94a32-3230-4516-9233-fa758d450798] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:59.380002 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-309efcfb-8157-4086-8977-8545eb3e1854 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:59.387561 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-309efcfb-8157-4086-8977-8545eb3e1854 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:59.388765 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-309efcfb-8157-4086-8977-8545eb3e1854 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:59.389679 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-309efcfb-8157-4086-8977-8545eb3e1854 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:59.438971 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-309efcfb-8157-4086-8977-8545eb3e1854 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: a8d94a32-3230-4516-9233-fa758d450798] Going to try to terminate instance {{(pid=124845) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 11:44:59.868730 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-309efcfb-8157-4086-8977-8545eb3e1854 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798" status: 204 len: 0 microversion: 2.1 time: 0.504306 Jun 17 11:44:59.870087 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 212/428] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 17 11:44:59 2022] DELETE /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 11:44:59.879566 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d4408a94-82e5-4d91-ab7f-2b2715bb1a81 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:44:59.880825 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d4408a94-82e5-4d91-ab7f-2b2715bb1a81 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: a8d94a32-3230-4516-9233-fa758d450798] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:44:59.890150 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d4408a94-82e5-4d91-ab7f-2b2715bb1a81 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:59.890890 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d4408a94-82e5-4d91-ab7f-2b2715bb1a81 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:44:59.892043 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d4408a94-82e5-4d91-ab7f-2b2715bb1a81 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:44:59.892485 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d4408a94-82e5-4d91-ab7f-2b2715bb1a81 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:00.137712 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-d53a4ed2-f81a-448d-94fd-2f911db93014 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:00.138632 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-d53a4ed2-f81a-448d-94fd-2f911db93014 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:00.150766 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d53a4ed2-f81a-448d-94fd-2f911db93014 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:00.154904 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d53a4ed2-f81a-448d-94fd-2f911db93014 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:00.156482 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d53a4ed2-f81a-448d-94fd-2f911db93014 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:00.160605 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d53a4ed2-f81a-448d-94fd-2f911db93014 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:00.202447 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d4408a94-82e5-4d91-ab7f-2b2715bb1a81 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:00.222641 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d4408a94-82e5-4d91-ab7f-2b2715bb1a81 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798" status: 200 len: 1681 microversion: 2.1 time: 0.348515 Jun 17 11:45:00.223846 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 217/429] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:44:59 2022] GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798 => generated 1681 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:00.341473 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f61d64b1-7bb8-4789-9693-f16257958586 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:00.370643 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f61d64b1-7bb8-4789-9693-f16257958586 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:00.370643 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f61d64b1-7bb8-4789-9693-f16257958586 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:00.370643 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f61d64b1-7bb8-4789-9693-f16257958586 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:00.370643 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f61d64b1-7bb8-4789-9693-f16257958586 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:00.372357 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f61d64b1-7bb8-4789-9693-f16257958586 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:00.565659 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-d53a4ed2-f81a-448d-94fd-2f911db93014 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:00.593732 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-d53a4ed2-f81a-448d-94fd-2f911db93014 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1734 microversion: 2.1 time: 0.459894 Jun 17 11:45:00.596880 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 213/430] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:00 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1734 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:45:00.644812 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f61d64b1-7bb8-4789-9693-f16257958586 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:00.655296 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f61d64b1-7bb8-4789-9693-f16257958586 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1679 microversion: 2.1 time: 0.328176 Jun 17 11:45:00.656099 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 218/431] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:00 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1679 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:01.246941 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ef430465-d530-4f14-8432-ca484fe2a860 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:01.249300 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-ef430465-d530-4f14-8432-ca484fe2a860 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: a8d94a32-3230-4516-9233-fa758d450798] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:01.262780 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ef430465-d530-4f14-8432-ca484fe2a860 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:01.263733 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ef430465-d530-4f14-8432-ca484fe2a860 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:01.266106 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ef430465-d530-4f14-8432-ca484fe2a860 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:01.269801 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ef430465-d530-4f14-8432-ca484fe2a860 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:01.616603 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-245e1098-8463-4848-900d-7810b223f19c tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:01.618034 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-245e1098-8463-4848-900d-7810b223f19c tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:01.631530 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-245e1098-8463-4848-900d-7810b223f19c tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:01.633223 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-245e1098-8463-4848-900d-7810b223f19c tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:01.635509 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-245e1098-8463-4848-900d-7810b223f19c tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:01.637078 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-245e1098-8463-4848-900d-7810b223f19c tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:02.133196 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ef430465-d530-4f14-8432-ca484fe2a860 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:02.145497 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-ef430465-d530-4f14-8432-ca484fe2a860 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798" status: 200 len: 1681 microversion: 2.1 time: 0.903015 Jun 17 11:45:02.153588 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 214/432] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:01 2022] GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798 => generated 1681 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:02.158905 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-070b003b-a361-4e36-97dd-0d951faa70fd tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:02.159565 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-070b003b-a361-4e36-97dd-0d951faa70fd tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:02.188905 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-070b003b-a361-4e36-97dd-0d951faa70fd tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:02.190929 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-070b003b-a361-4e36-97dd-0d951faa70fd tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:02.194249 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-070b003b-a361-4e36-97dd-0d951faa70fd tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:02.194958 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-070b003b-a361-4e36-97dd-0d951faa70fd tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:02.239390 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:45:02.498477 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-245e1098-8463-4848-900d-7810b223f19c tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:02.512001 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-245e1098-8463-4848-900d-7810b223f19c tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1734 microversion: 2.1 time: 0.900541 Jun 17 11:45:02.513535 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 219/433] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:01 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1734 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:02.559885 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-070b003b-a361-4e36-97dd-0d951faa70fd tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:02.581653 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-070b003b-a361-4e36-97dd-0d951faa70fd tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1679 microversion: 2.1 time: 0.417875 Jun 17 11:45:02.587203 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 215/434] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:02 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1679 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:03.167072 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d691faa4-30da-45ca-bb61-e29a999f7589 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:03.178196 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d691faa4-30da-45ca-bb61-e29a999f7589 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: a8d94a32-3230-4516-9233-fa758d450798] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:03.188916 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d691faa4-30da-45ca-bb61-e29a999f7589 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:03.192402 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d691faa4-30da-45ca-bb61-e29a999f7589 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:03.192402 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d691faa4-30da-45ca-bb61-e29a999f7589 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:03.192402 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d691faa4-30da-45ca-bb61-e29a999f7589 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:03.530363 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-5e1a71e4-0950-48c2-aeb5-a6edf3419bdc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:03.531289 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-5e1a71e4-0950-48c2-aeb5-a6edf3419bdc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:03.544553 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:45:03.553458 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5e1a71e4-0950-48c2-aeb5-a6edf3419bdc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:03.553931 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5e1a71e4-0950-48c2-aeb5-a6edf3419bdc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:03.554733 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5e1a71e4-0950-48c2-aeb5-a6edf3419bdc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:03.555177 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5e1a71e4-0950-48c2-aeb5-a6edf3419bdc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:03.739463 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d691faa4-30da-45ca-bb61-e29a999f7589 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:03.754358 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d691faa4-30da-45ca-bb61-e29a999f7589 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798" status: 200 len: 1681 microversion: 2.1 time: 0.593453 Jun 17 11:45:03.755238 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 220/435] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:03 2022] GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798 => generated 1681 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:03.764090 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f64e5d36-1978-4a4f-9f4b-46a47da4c2fc tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:03.769728 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f64e5d36-1978-4a4f-9f4b-46a47da4c2fc tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:03.792125 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f64e5d36-1978-4a4f-9f4b-46a47da4c2fc tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:03.792971 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f64e5d36-1978-4a4f-9f4b-46a47da4c2fc tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:03.796051 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f64e5d36-1978-4a4f-9f4b-46a47da4c2fc tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:03.799561 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f64e5d36-1978-4a4f-9f4b-46a47da4c2fc tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:04.521730 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5e1a71e4-0950-48c2-aeb5-a6edf3419bdc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:04.560516 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-5e1a71e4-0950-48c2-aeb5-a6edf3419bdc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1734 microversion: 2.1 time: 1.033693 Jun 17 11:45:04.561219 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 216/436] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:03 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1734 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:45:04.748820 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f64e5d36-1978-4a4f-9f4b-46a47da4c2fc tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:04.763070 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f64e5d36-1978-4a4f-9f4b-46a47da4c2fc tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1679 microversion: 2.1 time: 1.005637 Jun 17 11:45:04.777817 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-dbeb1fdf-888b-4bf5-a024-5051342625cb tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:04.783037 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-dbeb1fdf-888b-4bf5-a024-5051342625cb tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: a8d94a32-3230-4516-9233-fa758d450798] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:04.784866 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 221/437] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:03 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1679 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:04.801914 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-dbeb1fdf-888b-4bf5-a024-5051342625cb tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:04.803612 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-dbeb1fdf-888b-4bf5-a024-5051342625cb tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:04.817418 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-dbeb1fdf-888b-4bf5-a024-5051342625cb tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:04.819038 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-dbeb1fdf-888b-4bf5-a024-5051342625cb tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:05.063131 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-dbeb1fdf-888b-4bf5-a024-5051342625cb tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:05.077079 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-dbeb1fdf-888b-4bf5-a024-5051342625cb tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798" status: 200 len: 1613 microversion: 2.1 time: 0.306898 Jun 17 11:45:05.079142 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 217/438] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:04 2022] GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798 => generated 1613 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:05.238686 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-850beaf1-3a09-4f31-a69e-56e22113066f req-87a66405-d024-4d8f-8fa4-a42329b6624b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8d94a32-3230-4516-9233-fa758d450798", "name": "network-vif-deleted", "tag": "64e882c6-f99d-40c3-9d04-6f350ee05b98"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:45:05.262134 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-850beaf1-3a09-4f31-a69e-56e22113066f req-87a66405-d024-4d8f-8fa4-a42329b6624b service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:05.265907 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-850beaf1-3a09-4f31-a69e-56e22113066f req-87a66405-d024-4d8f-8fa4-a42329b6624b service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:05.291994 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-850beaf1-3a09-4f31-a69e-56e22113066f req-87a66405-d024-4d8f-8fa4-a42329b6624b service nova] Creating event network-vif-deleted:64e882c6-f99d-40c3-9d04-6f350ee05b98 for instance a8d94a32-3230-4516-9233-fa758d450798 on hv-cinder-83716 Jun 17 11:45:05.300575 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-850beaf1-3a09-4f31-a69e-56e22113066f req-87a66405-d024-4d8f-8fa4-a42329b6624b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067372 Jun 17 11:45:05.302721 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 222/439] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:45:05.581595 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e249816e-2022-4405-b768-0df898648a1e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:05.582957 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-e249816e-2022-4405-b768-0df898648a1e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:05.594167 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e249816e-2022-4405-b768-0df898648a1e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:05.594894 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e249816e-2022-4405-b768-0df898648a1e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:05.595971 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e249816e-2022-4405-b768-0df898648a1e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:05.596659 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e249816e-2022-4405-b768-0df898648a1e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:05.782652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-91831fe3-8344-4c56-bea1-a1cff8b515d1 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:05.795136 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-91831fe3-8344-4c56-bea1-a1cff8b515d1 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:05.799471 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-91831fe3-8344-4c56-bea1-a1cff8b515d1 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:05.800464 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-91831fe3-8344-4c56-bea1-a1cff8b515d1 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:05.801521 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-91831fe3-8344-4c56-bea1-a1cff8b515d1 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:05.802232 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-91831fe3-8344-4c56-bea1-a1cff8b515d1 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:05.919158 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-e249816e-2022-4405-b768-0df898648a1e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:05.940150 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-e249816e-2022-4405-b768-0df898648a1e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1714 microversion: 2.1 time: 0.352799 Jun 17 11:45:05.942228 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 218/440] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:05 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1714 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:06.099198 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-3e521060-3ebb-4fc7-acf2-ab3779bb789e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:06.102669 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-3e521060-3ebb-4fc7-acf2-ab3779bb789e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: a8d94a32-3230-4516-9233-fa758d450798] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:06.115419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3e521060-3ebb-4fc7-acf2-ab3779bb789e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:06.115973 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3e521060-3ebb-4fc7-acf2-ab3779bb789e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:06.116809 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3e521060-3ebb-4fc7-acf2-ab3779bb789e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:06.120507 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3e521060-3ebb-4fc7-acf2-ab3779bb789e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:06.185287 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-91831fe3-8344-4c56-bea1-a1cff8b515d1 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:06.201142 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-91831fe3-8344-4c56-bea1-a1cff8b515d1 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1679 microversion: 2.1 time: 0.418531 Jun 17 11:45:06.202068 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 223/441] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:05 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1679 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:45:06.209754 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3e521060-3ebb-4fc7-acf2-ab3779bb789e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:06.212437 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3e521060-3ebb-4fc7-acf2-ab3779bb789e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:06.212607 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e2db6940-431b-46c4-bc22-344d369b5e35 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:06.213046 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e2db6940-431b-46c4-bc22-344d369b5e35 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:06.214661 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-3e521060-3ebb-4fc7-acf2-ab3779bb789e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lazy-loading 'fault' on Instance uuid a8d94a32-3230-4516-9233-fa758d450798 {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:45:06.243105 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e2db6940-431b-46c4-bc22-344d369b5e35 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:06.250673 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e2db6940-431b-46c4-bc22-344d369b5e35 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:06.255215 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e2db6940-431b-46c4-bc22-344d369b5e35 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:06.267748 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e2db6940-431b-46c4-bc22-344d369b5e35 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:06.334478 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-3e521060-3ebb-4fc7-acf2-ab3779bb789e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:06.398739 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-3e521060-3ebb-4fc7-acf2-ab3779bb789e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798" status: 200 len: 1331 microversion: 2.1 time: 0.305245 Jun 17 11:45:06.417062 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 219/442] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:06 2022] GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798 => generated 1331 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:45:06.638126 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-e2db6940-431b-46c4-bc22-344d369b5e35 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] HTTP exception thrown: Cannot 'detach_volume' instance 9a27dd59-4638-430d-a484-d38ed6fcf923 while it is in vm_state rescued Jun 17 11:45:06.640679 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e2db6940-431b-46c4-bc22-344d369b5e35 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Request method failure captured: Jun 17 11:45:06.640679 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: request: DELETE /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923/os-volume_attachments/67653af2-2434-4859-b288-fce97f70ad1c HTTP/1.1 Jun 17 11:45:06.640679 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept: application/json Jun 17 11:45:06.640679 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jun 17 11:45:06.640679 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Connection: close Jun 17 11:45:06.640679 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jun 17 11:45:06.640679 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jun 17 11:45:06.640679 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Host: 10.222.0.45 Jun 17 11:45:06.640679 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jun 17 11:45:06.640679 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jun 17 11:45:06.640679 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABirGhYXPEneGbWlDHr4IdGyKcI2lSvyu7_ndCScBUrORne39u-qQqZEMZQFH6SJDovDOcnVKjNuoxzr715SnSXgShkw-ZY_5pruDdyzsw0BrOMIBFmyx6bizWQou_OUbd6ovLhc1PtNOl8-D1aQsyvMYXlGV0IY28idRqZ__sES5ASbXg Jun 17 11:45:06.640679 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jun 17 11:45:06.640679 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jun 17 11:45:06.640679 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jun 17 11:45:06.640679 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jun 17 11:45:06.640679 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jun 17 11:45:06.640679 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jun 17 11:45:06.640679 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Id: e38262ed2ed84004a6e01d423cadcae4 Jun 17 11:45:06.640679 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1413190309 Jun 17 11:45:06.640679 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Role: member,reader Jun 17 11:45:06.640679 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Roles: member,reader Jun 17 11:45:06.642101 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e38262ed2ed84004a6e01d423cadcae4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e38262ed2ed84004a6e01d423cadcae4", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e38262ed2ed84004a6e01d423cadcae4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e38262ed2ed84004a6e01d423cadcae4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:45:06.642101 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1413190309 Jun 17 11:45:06.642101 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Id: e38262ed2ed84004a6e01d423cadcae4 Jun 17 11:45:06.642101 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1413190309 Jun 17 11:45:06.642101 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User: tempest-ServerRescueNegativeTestJSON-1413190309-project Jun 17 11:45:06.642101 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jun 17 11:45:06.642101 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jun 17 11:45:06.642101 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Id: a79957b3f2e94f31bd2cb82290ed0962 Jun 17 11:45:06.642101 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1413190309-project Jun 17 11:45:06.642101 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: method: > Jun 17 11:45:06.642101 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: exception: Cannot 'detach_volume' instance 9a27dd59-4638-430d-a484-d38ed6fcf923 while it is in vm_state rescued Jun 17 11:45:06.642768 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: action_args: {'server_id': '9a27dd59-4638-430d-a484-d38ed6fcf923', 'id': '67653af2-2434-4859-b288-fce97f70ad1c'} Jun 17 11:45:06.642768 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:45:06.642768 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:45:06.642768 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 11:45:06.642768 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 11:45:06.642768 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 11:45:06.642768 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 11:45:06.642768 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 17 11:45:06.642768 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 17 11:45:06.642768 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9a27dd59-4638-430d-a484-d38ed6fcf923 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 17 11:45:06.642768 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:45:06.642768 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:45:06.642768 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:45:06.642768 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:45:06.642768 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:45:06.642768 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:45:06.642768 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:45:06.642768 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:45:06.642768 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:45:06.642768 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:45:06.644061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 17 11:45:06.644061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 17 11:45:06.644061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 17 11:45:06.644061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 17 11:45:06.644061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 9a27dd59-4638-430d-a484-d38ed6fcf923 while it is in vm_state rescued Jun 17 11:45:06.644061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:45:06.644061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:45:06.644061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:45:06.644061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:45:06.644061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:45:06.644061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:45:06.644061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:45:06.644061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:45:06.644061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 9a27dd59-4638-430d-a484-d38ed6fcf923 while it is in vm_state rescued Jun 17 11:45:06.644061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:45:06.647617 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e2db6940-431b-46c4-bc22-344d369b5e35 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Returning 409 to user: Cannot 'detach_volume' instance 9a27dd59-4638-430d-a484-d38ed6fcf923 while it is in vm_state rescued {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:45:06.648751 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e2db6940-431b-46c4-bc22-344d369b5e35 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923/os-volume_attachments/67653af2-2434-4859-b288-fce97f70ad1c" status: 409 len: 152 microversion: 2.1 time: 0.443177 Jun 17 11:45:06.649610 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 224/443] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Jun 17 11:45:06 2022] DELETE /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923/os-volume_attachments/67653af2-2434-4859-b288-fce97f70ad1c => generated 152 bytes in 445 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 17 11:45:06.662979 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-54bc3aaf-8fdd-4563-b675-a5ed4185c245 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:45:06.663552 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-54bc3aaf-8fdd-4563-b675-a5ed4185c245 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:06.691115 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-54bc3aaf-8fdd-4563-b675-a5ed4185c245 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:06.691942 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-54bc3aaf-8fdd-4563-b675-a5ed4185c245 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:06.698299 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-54bc3aaf-8fdd-4563-b675-a5ed4185c245 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:06.705783 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-54bc3aaf-8fdd-4563-b675-a5ed4185c245 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:07.133813 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-54bc3aaf-8fdd-4563-b675-a5ed4185c245 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "POST /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923/action" status: 202 len: 0 microversion: 2.1 time: 0.469595 Jun 17 11:45:07.133813 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 220/444] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jun 17 11:45:06 2022] POST /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 11:45:07.144783 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ced5ea2d-ac37-4ea6-964d-b958ddd4f78c tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:07.144783 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ced5ea2d-ac37-4ea6-964d-b958ddd4f78c tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:07.165028 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ced5ea2d-ac37-4ea6-964d-b958ddd4f78c tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:07.168414 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ced5ea2d-ac37-4ea6-964d-b958ddd4f78c tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:07.169476 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ced5ea2d-ac37-4ea6-964d-b958ddd4f78c tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:07.172471 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ced5ea2d-ac37-4ea6-964d-b958ddd4f78c tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:07.224289 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f234c75b-29bd-4c73-9e19-14f5bc5189fc tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:07.225010 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f234c75b-29bd-4c73-9e19-14f5bc5189fc tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:07.246312 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f234c75b-29bd-4c73-9e19-14f5bc5189fc tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:07.246956 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f234c75b-29bd-4c73-9e19-14f5bc5189fc tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:07.251568 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f234c75b-29bd-4c73-9e19-14f5bc5189fc tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:07.268984 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f234c75b-29bd-4c73-9e19-14f5bc5189fc tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:08.389864 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f234c75b-29bd-4c73-9e19-14f5bc5189fc tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:08.414984 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f234c75b-29bd-4c73-9e19-14f5bc5189fc tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1679 microversion: 2.1 time: 1.194464 Jun 17 11:45:08.420706 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 221/445] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:07 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1679 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:08.447156 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-33b7aadf-cd21-4360-b18a-64cd8b736e14 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:08.452456 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-33b7aadf-cd21-4360-b18a-64cd8b736e14 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: a8d94a32-3230-4516-9233-fa758d450798] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:08.507673 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-33b7aadf-cd21-4360-b18a-64cd8b736e14 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:08.507925 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ced5ea2d-ac37-4ea6-964d-b958ddd4f78c tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:08.509130 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-33b7aadf-cd21-4360-b18a-64cd8b736e14 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:08.510195 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-33b7aadf-cd21-4360-b18a-64cd8b736e14 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:08.510839 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-33b7aadf-cd21-4360-b18a-64cd8b736e14 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:08.550560 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ced5ea2d-ac37-4ea6-964d-b958ddd4f78c tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1722 microversion: 2.1 time: 1.414556 Jun 17 11:45:08.552157 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-33b7aadf-cd21-4360-b18a-64cd8b736e14 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] HTTP exception thrown: Instance a8d94a32-3230-4516-9233-fa758d450798 could not be found. Jun 17 11:45:08.554441 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-33b7aadf-cd21-4360-b18a-64cd8b736e14 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Request method failure captured: Jun 17 11:45:08.554441 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798 HTTP/1.1 Jun 17 11:45:08.554441 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jun 17 11:45:08.554441 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jun 17 11:45:08.554441 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Connection: close Jun 17 11:45:08.554441 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jun 17 11:45:08.554441 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jun 17 11:45:08.554441 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.45 Jun 17 11:45:08.554441 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jun 17 11:45:08.554441 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jun 17 11:45:08.554441 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABirGhbQZN58Mc4zyhUveG-Q-SFsZYiqbX0gxyltnPVCjSfEYNyfXfhfVCx5KdbK5qhE4EnaiOrUEMOKAhCCD_-tiKGRwJFUZvlEPvpBXY3_SY-UVihK6NaeFSNbrNpsHezSsj02ro8zcS2-cKoHlRfS3nCqLWBYJ5x0JyaHmYJlkw7b68 Jun 17 11:45:08.554441 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jun 17 11:45:08.554441 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jun 17 11:45:08.554441 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jun 17 11:45:08.554441 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jun 17 11:45:08.554441 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jun 17 11:45:08.554441 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jun 17 11:45:08.554441 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Id: c58cf63264414f30a98161f6027daad0 Jun 17 11:45:08.554441 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:45:08.554441 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jun 17 11:45:08.554441 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jun 17 11:45:08.556132 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c58cf63264414f30a98161f6027daad0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c58cf63264414f30a98161f6027daad0", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c58cf63264414f30a98161f6027daad0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c58cf63264414f30a98161f6027daad0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:45:08.556132 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:45:08.556132 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: c58cf63264414f30a98161f6027daad0 Jun 17 11:45:08.556132 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:45:08.556132 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User: tempest-AttachVolumeNegativeTest-1942846496-project Jun 17 11:45:08.556132 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jun 17 11:45:08.556132 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jun 17 11:45:08.556132 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Id: 2e58eacbbb9e41fdbbb13f5b39be782a Jun 17 11:45:08.556132 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-AttachVolumeNegativeTest-1942846496-project Jun 17 11:45:08.556132 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: method: > Jun 17 11:45:08.556132 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: exception: Instance a8d94a32-3230-4516-9233-fa758d450798 could not be found. Jun 17 11:45:08.556132 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: action_args: {'id': 'a8d94a32-3230-4516-9233-fa758d450798'} Jun 17 11:45:08.556926 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:45:08.556926 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:45:08.556926 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:45:08.556926 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:45:08.556926 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:45:08.556926 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:45:08.556926 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:45:08.556926 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:45:08.556926 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:45:08.556926 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:45:08.556926 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8d94a32-3230-4516-9233-fa758d450798 could not be found. Jun 17 11:45:08.556926 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:45:08.556926 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:45:08.556926 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:45:08.556926 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:45:08.556926 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:45:08.556926 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:45:08.556926 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:45:08.556926 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:45:08.556926 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:45:08.558066 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:45:08.558066 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 11:45:08.558066 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 11:45:08.558066 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:45:08.558066 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:45:08.558066 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:45:08.558066 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:45:08.558066 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8d94a32-3230-4516-9233-fa758d450798 could not be found. Jun 17 11:45:08.558066 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:45:08.558066 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:45:08.558066 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:45:08.558066 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:45:08.558066 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:45:08.558066 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:45:08.558066 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:45:08.558066 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:45:08.558066 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8d94a32-3230-4516-9233-fa758d450798 could not be found. Jun 17 11:45:08.558066 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:45:08.560787 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-33b7aadf-cd21-4360-b18a-64cd8b736e14 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Returning 404 to user: Instance a8d94a32-3230-4516-9233-fa758d450798 could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:45:08.565671 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-33b7aadf-cd21-4360-b18a-64cd8b736e14 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798" status: 404 len: 111 microversion: 2.1 time: 0.143777 Jun 17 11:45:08.566225 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 225/446] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:07 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1722 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:08.567139 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 222/447] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:08 2022] GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:45:08.590593 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-79633ba3-5d96-4b2c-9850-08d37fca4c9a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '.version_select at 0x7f9c768d21f0>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:08.726135 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-79633ba3-5d96-4b2c-9850-08d37fca4c9a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-382923722" status: 202 len: 0 microversion: 2.1 time: 0.152614 Jun 17 11:45:08.727167 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 226/448] 10.222.0.45 () {58 vars in 1217 bytes} [Fri Jun 17 11:45:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-382923722 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 11:45:09.433230 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-418c80d9-6b71-45e0-bdae-7ab2b2d0313b tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:09.434544 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-418c80d9-6b71-45e0-bdae-7ab2b2d0313b tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:09.451827 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-418c80d9-6b71-45e0-bdae-7ab2b2d0313b tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:09.454159 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-418c80d9-6b71-45e0-bdae-7ab2b2d0313b tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:09.456868 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-418c80d9-6b71-45e0-bdae-7ab2b2d0313b tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:09.457604 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-418c80d9-6b71-45e0-bdae-7ab2b2d0313b tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:09.588930 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6416cd94-fad9-45b2-974c-3f71c0803ec3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:09.590619 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-6416cd94-fad9-45b2-974c-3f71c0803ec3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:09.612920 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6416cd94-fad9-45b2-974c-3f71c0803ec3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:09.614097 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6416cd94-fad9-45b2-974c-3f71c0803ec3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:09.616099 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6416cd94-fad9-45b2-974c-3f71c0803ec3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:09.617564 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6416cd94-fad9-45b2-974c-3f71c0803ec3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:10.357874 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-6416cd94-fad9-45b2-974c-3f71c0803ec3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:10.400133 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-6416cd94-fad9-45b2-974c-3f71c0803ec3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1722 microversion: 2.1 time: 0.812600 Jun 17 11:45:10.400133 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 227/449] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:09 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1722 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:10.404180 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-418c80d9-6b71-45e0-bdae-7ab2b2d0313b tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:10.428601 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-418c80d9-6b71-45e0-bdae-7ab2b2d0313b tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1679 microversion: 2.1 time: 0.999340 Jun 17 11:45:10.434212 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 223/450] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:09 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1679 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:11.261432 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-93ab115c-bee0-4795-9ea6-e4a111516b87 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:11.262601 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-93ab115c-bee0-4795-9ea6-e4a111516b87 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: be48aa4e-115e-4d58-8940-f722120f4664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:11.276564 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-93ab115c-bee0-4795-9ea6-e4a111516b87 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:11.276564 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-93ab115c-bee0-4795-9ea6-e4a111516b87 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:11.279996 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-93ab115c-bee0-4795-9ea6-e4a111516b87 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:11.280648 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-93ab115c-bee0-4795-9ea6-e4a111516b87 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:11.415009 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-3ef38e26-81b1-40b9-8d55-f5be0b6303d5 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:11.415691 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-3ef38e26-81b1-40b9-8d55-f5be0b6303d5 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:11.424608 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3ef38e26-81b1-40b9-8d55-f5be0b6303d5 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:11.424608 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3ef38e26-81b1-40b9-8d55-f5be0b6303d5 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:11.431409 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3ef38e26-81b1-40b9-8d55-f5be0b6303d5 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:11.431409 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3ef38e26-81b1-40b9-8d55-f5be0b6303d5 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:11.581550 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-93ab115c-bee0-4795-9ea6-e4a111516b87 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lazy-loading 'services' on Instance uuid be48aa4e-115e-4d58-8940-f722120f4664 {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:45:11.972351 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-3ef38e26-81b1-40b9-8d55-f5be0b6303d5 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:11.975053 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-93ab115c-bee0-4795-9ea6-e4a111516b87 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "DELETE /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664/os-volume_attachments/41bb0945-b2db-47bd-aaa1-dc0fdab9c83e" status: 202 len: 0 microversion: 2.1 time: 0.717378 Jun 17 11:45:11.975725 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 228/451] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Jun 17 11:45:11 2022] DELETE /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664/os-volume_attachments/41bb0945-b2db-47bd-aaa1-dc0fdab9c83e => generated 0 bytes in 719 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 11:45:11.989968 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-fa7ba8f9-f8cb-4c77-9188-f1bdb5c06222 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:11.994685 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-fa7ba8f9-f8cb-4c77-9188-f1bdb5c06222 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:12.009457 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-3ef38e26-81b1-40b9-8d55-f5be0b6303d5 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1722 microversion: 2.1 time: 0.594742 Jun 17 11:45:12.021316 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fa7ba8f9-f8cb-4c77-9188-f1bdb5c06222 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:12.021316 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fa7ba8f9-f8cb-4c77-9188-f1bdb5c06222 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:12.021316 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fa7ba8f9-f8cb-4c77-9188-f1bdb5c06222 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:12.021316 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fa7ba8f9-f8cb-4c77-9188-f1bdb5c06222 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:12.022034 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 224/452] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:11 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1722 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:45:12.042098 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-dc3ebc6a-ab56-4688-ba14-a5a44591028f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:12.043335 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-dc3ebc6a-ab56-4688-ba14-a5a44591028f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: be48aa4e-115e-4d58-8940-f722120f4664] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:12.058151 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-dc3ebc6a-ab56-4688-ba14-a5a44591028f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:12.058592 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-dc3ebc6a-ab56-4688-ba14-a5a44591028f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:12.068639 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-dc3ebc6a-ab56-4688-ba14-a5a44591028f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:12.071643 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-dc3ebc6a-ab56-4688-ba14-a5a44591028f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:12.217042 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-dc3ebc6a-ab56-4688-ba14-a5a44591028f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.196742 Jun 17 11:45:12.219296 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 225/453] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 17 11:45:12 2022] GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:45:12.580453 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-fa7ba8f9-f8cb-4c77-9188-f1bdb5c06222 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:12.598794 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-fa7ba8f9-f8cb-4c77-9188-f1bdb5c06222 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1656 microversion: 2.1 time: 0.620985 Jun 17 11:45:12.600619 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 229/454] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:11 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1656 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:12.620957 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-17cd345e-c697-475e-82f6-79b577efed32 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:45:12.638775 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-17cd345e-c697-475e-82f6-79b577efed32 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:12.639343 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-17cd345e-c697-475e-82f6-79b577efed32 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:12.710187 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-17cd345e-c697-475e-82f6-79b577efed32 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Going to try to start instance {{(pid=124845) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 17 11:45:13.034604 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e52b707c-5074-4550-a3d0-5d04003ccd50 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:13.041236 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e52b707c-5074-4550-a3d0-5d04003ccd50 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:13.062396 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e52b707c-5074-4550-a3d0-5d04003ccd50 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:13.071876 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e52b707c-5074-4550-a3d0-5d04003ccd50 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:13.083094 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e52b707c-5074-4550-a3d0-5d04003ccd50 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:13.091919 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e52b707c-5074-4550-a3d0-5d04003ccd50 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:13.120979 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-17cd345e-c697-475e-82f6-79b577efed32 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "POST /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2/action" status: 202 len: 0 microversion: 2.1 time: 0.506109 Jun 17 11:45:13.124897 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 226/455] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jun 17 11:45:12 2022] POST /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2/action => generated 0 bytes in 511 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 11:45:13.131038 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-5ae0f017-dc2f-4f7a-ae5d-2f48a74512df tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:13.137546 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-5ae0f017-dc2f-4f7a-ae5d-2f48a74512df tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:13.166165 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5ae0f017-dc2f-4f7a-ae5d-2f48a74512df tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:13.167217 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5ae0f017-dc2f-4f7a-ae5d-2f48a74512df tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:13.168490 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5ae0f017-dc2f-4f7a-ae5d-2f48a74512df tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:13.174928 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5ae0f017-dc2f-4f7a-ae5d-2f48a74512df tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:13.897052 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e52b707c-5074-4550-a3d0-5d04003ccd50 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:13.911319 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e52b707c-5074-4550-a3d0-5d04003ccd50 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1728 microversion: 2.1 time: 0.880750 Jun 17 11:45:13.917102 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5ae0f017-dc2f-4f7a-ae5d-2f48a74512df tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:13.932863 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-5ae0f017-dc2f-4f7a-ae5d-2f48a74512df tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1665 microversion: 2.1 time: 0.806116 Jun 17 11:45:13.941335 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 227/456] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:13 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1665 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:13.944288 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 230/457] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:13 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1728 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:13.954814 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-65703066-9df0-4c20-a383-d3a0e319ce63 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:13.956097 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-65703066-9df0-4c20-a383-d3a0e319ce63 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:13.959146 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-dec4b884-19a1-46b9-8516-254ab1704f0a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:13.972411 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-65703066-9df0-4c20-a383-d3a0e319ce63 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:13.977375 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-65703066-9df0-4c20-a383-d3a0e319ce63 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:13.982852 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-dec4b884-19a1-46b9-8516-254ab1704f0a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: be48aa4e-115e-4d58-8940-f722120f4664] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:13.984761 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-65703066-9df0-4c20-a383-d3a0e319ce63 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:13.986445 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-65703066-9df0-4c20-a383-d3a0e319ce63 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:14.018018 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-dec4b884-19a1-46b9-8516-254ab1704f0a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:14.025683 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=98 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:45:14.035699 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-dec4b884-19a1-46b9-8516-254ab1704f0a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:14.037788 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-dec4b884-19a1-46b9-8516-254ab1704f0a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:14.037788 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-dec4b884-19a1-46b9-8516-254ab1704f0a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:14.106658 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-dec4b884-19a1-46b9-8516-254ab1704f0a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.163765 Jun 17 11:45:14.114177 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 228/458] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 17 11:45:13 2022] GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664/os-volume_attachments => generated 25 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 11:45:14.288234 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-65703066-9df0-4c20-a383-d3a0e319ce63 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.342161 Jun 17 11:45:14.299015 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 231/459] 10.222.0.45 () {58 vars in 1274 bytes} [Fri Jun 17 11:45:13 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923/os-interface => generated 284 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:45:14.303141 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-70a176a8-628a-4c6a-9faa-29797633a135 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:14.304327 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-70a176a8-628a-4c6a-9faa-29797633a135 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: be48aa4e-115e-4d58-8940-f722120f4664] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:14.325904 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-70a176a8-628a-4c6a-9faa-29797633a135 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:14.326641 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-70a176a8-628a-4c6a-9faa-29797633a135 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:14.331620 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-70a176a8-628a-4c6a-9faa-29797633a135 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:14.339565 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-70a176a8-628a-4c6a-9faa-29797633a135 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:14.423544 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-70a176a8-628a-4c6a-9faa-29797633a135 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: be48aa4e-115e-4d58-8940-f722120f4664] Going to try to terminate instance {{(pid=124845) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 11:45:14.458788 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:45:14.957295 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-76bce67a-c61f-411f-99a6-05bddcfb5421 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:14.959625 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-76bce67a-c61f-411f-99a6-05bddcfb5421 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:14.985508 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-70a176a8-628a-4c6a-9faa-29797633a135 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "DELETE /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664" status: 204 len: 0 microversion: 2.1 time: 0.693681 Jun 17 11:45:14.987150 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 229/460] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 17 11:45:14 2022] DELETE /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 17 11:45:14.993063 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-76bce67a-c61f-411f-99a6-05bddcfb5421 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:14.998463 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f88e8fcd-274b-42f3-9af9-8a694ea2b16f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:14.999332 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-76bce67a-c61f-411f-99a6-05bddcfb5421 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:14.999565 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f88e8fcd-274b-42f3-9af9-8a694ea2b16f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: be48aa4e-115e-4d58-8940-f722120f4664] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:15.004177 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-76bce67a-c61f-411f-99a6-05bddcfb5421 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:15.004798 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-76bce67a-c61f-411f-99a6-05bddcfb5421 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:15.027683 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f88e8fcd-274b-42f3-9af9-8a694ea2b16f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:15.029535 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f88e8fcd-274b-42f3-9af9-8a694ea2b16f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:15.032135 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f88e8fcd-274b-42f3-9af9-8a694ea2b16f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:15.033312 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f88e8fcd-274b-42f3-9af9-8a694ea2b16f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:15.840698 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f88e8fcd-274b-42f3-9af9-8a694ea2b16f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:15.857803 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-76bce67a-c61f-411f-99a6-05bddcfb5421 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:15.865493 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f88e8fcd-274b-42f3-9af9-8a694ea2b16f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664" status: 200 len: 1678 microversion: 2.1 time: 0.872293 Jun 17 11:45:15.866136 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 230/461] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:14 2022] GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664 => generated 1678 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:15.872655 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-76bce67a-c61f-411f-99a6-05bddcfb5421 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1665 microversion: 2.1 time: 0.922207 Jun 17 11:45:15.889252 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 232/462] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:14 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1665 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:45:16.896632 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-12882092-4ff9-412c-aa19-6115f5c64b23 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:16.897763 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4f5f5921-2367-4120-a94c-c8dba59350e5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:16.898441 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4f5f5921-2367-4120-a94c-c8dba59350e5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:16.902542 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-12882092-4ff9-412c-aa19-6115f5c64b23 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: be48aa4e-115e-4d58-8940-f722120f4664] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:16.922701 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4f5f5921-2367-4120-a94c-c8dba59350e5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:16.926920 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-12882092-4ff9-412c-aa19-6115f5c64b23 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:16.927622 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4f5f5921-2367-4120-a94c-c8dba59350e5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:16.936661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4f5f5921-2367-4120-a94c-c8dba59350e5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:16.938142 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-12882092-4ff9-412c-aa19-6115f5c64b23 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:16.939873 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-12882092-4ff9-412c-aa19-6115f5c64b23 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:16.940132 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4f5f5921-2367-4120-a94c-c8dba59350e5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:16.943621 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-12882092-4ff9-412c-aa19-6115f5c64b23 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:17.576093 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-12882092-4ff9-412c-aa19-6115f5c64b23 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:17.602097 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-12882092-4ff9-412c-aa19-6115f5c64b23 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664" status: 200 len: 1678 microversion: 2.1 time: 0.719223 Jun 17 11:45:17.602802 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 231/463] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:16 2022] GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664 => generated 1678 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:17.693612 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4f5f5921-2367-4120-a94c-c8dba59350e5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:17.719060 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4f5f5921-2367-4120-a94c-c8dba59350e5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1665 microversion: 2.1 time: 0.812847 Jun 17 11:45:17.728864 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 233/464] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:16 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1665 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:18.468929 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-cd7a2f27-b5fc-4743-903e-2fb1f9a62fbd req-5dbe820a-6d88-45ca-b353-0157589d7e90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a27dd59-4638-430d-a484-d38ed6fcf923", "tag": "673fb82d-43c8-4e9f-bf01-47ee2806f33a"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:45:18.497204 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-cd7a2f27-b5fc-4743-903e-2fb1f9a62fbd req-5dbe820a-6d88-45ca-b353-0157589d7e90 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:18.500723 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-cd7a2f27-b5fc-4743-903e-2fb1f9a62fbd req-5dbe820a-6d88-45ca-b353-0157589d7e90 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:18.538051 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-cd7a2f27-b5fc-4743-903e-2fb1f9a62fbd req-5dbe820a-6d88-45ca-b353-0157589d7e90 service nova] Creating event network-changed:673fb82d-43c8-4e9f-bf01-47ee2806f33a for instance 9a27dd59-4638-430d-a484-d38ed6fcf923 on hv-cinder-83716 Jun 17 11:45:18.550275 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-cd7a2f27-b5fc-4743-903e-2fb1f9a62fbd req-5dbe820a-6d88-45ca-b353-0157589d7e90 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094172 Jun 17 11:45:18.553459 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 232/465] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:45:18.625776 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-7960d77b-eb83-4a9a-ac4e-89d8b3cedf05 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:18.639875 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7960d77b-eb83-4a9a-ac4e-89d8b3cedf05 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: be48aa4e-115e-4d58-8940-f722120f4664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:18.648310 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:45:18.650462 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7960d77b-eb83-4a9a-ac4e-89d8b3cedf05 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:18.662567 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7960d77b-eb83-4a9a-ac4e-89d8b3cedf05 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:18.664570 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7960d77b-eb83-4a9a-ac4e-89d8b3cedf05 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:18.665548 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7960d77b-eb83-4a9a-ac4e-89d8b3cedf05 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:18.745982 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f8021bf5-6312-4e56-9775-9ff75c195d61 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:18.746690 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f8021bf5-6312-4e56-9775-9ff75c195d61 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:18.760638 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f8021bf5-6312-4e56-9775-9ff75c195d61 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:18.761563 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f8021bf5-6312-4e56-9775-9ff75c195d61 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:18.763510 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f8021bf5-6312-4e56-9775-9ff75c195d61 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:18.764143 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f8021bf5-6312-4e56-9775-9ff75c195d61 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:19.280863 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7960d77b-eb83-4a9a-ac4e-89d8b3cedf05 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:19.299199 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-7960d77b-eb83-4a9a-ac4e-89d8b3cedf05 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664" status: 200 len: 1678 microversion: 2.1 time: 0.682158 Jun 17 11:45:19.317303 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 234/466] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:18 2022] GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664 => generated 1678 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:19.555260 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f8021bf5-6312-4e56-9775-9ff75c195d61 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:19.573057 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f8021bf5-6312-4e56-9775-9ff75c195d61 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1669 microversion: 2.1 time: 0.831451 Jun 17 11:45:19.573663 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 233/467] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:18 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1669 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:20.336300 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-85a81dc1-6e0b-46a0-bd4a-029247d7becc tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:20.337644 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-85a81dc1-6e0b-46a0-bd4a-029247d7becc tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: be48aa4e-115e-4d58-8940-f722120f4664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:20.361838 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-85a81dc1-6e0b-46a0-bd4a-029247d7becc tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:20.364369 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-85a81dc1-6e0b-46a0-bd4a-029247d7becc tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:20.366342 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-85a81dc1-6e0b-46a0-bd4a-029247d7becc tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:20.368064 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-85a81dc1-6e0b-46a0-bd4a-029247d7becc tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:20.502174 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-85a81dc1-6e0b-46a0-bd4a-029247d7becc tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:20.517371 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-85a81dc1-6e0b-46a0-bd4a-029247d7becc tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664" status: 200 len: 1611 microversion: 2.1 time: 0.185244 Jun 17 11:45:20.518195 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 235/468] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:20 2022] GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664 => generated 1611 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:20.608160 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-512358bd-a711-4bc1-b33b-9bd60153ba3f req-2cb46dd9-29ac-4c47-8a00-7f0a28024e70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a27dd59-4638-430d-a484-d38ed6fcf923", "tag": "673fb82d-43c8-4e9f-bf01-47ee2806f33a"}, {"server_uuid": "be48aa4e-115e-4d58-8940-f722120f4664", "name": "network-vif-deleted", "tag": "8539e658-97e4-4b54-88b0-968fec4fe3fa"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:45:20.631403 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-512358bd-a711-4bc1-b33b-9bd60153ba3f req-2cb46dd9-29ac-4c47-8a00-7f0a28024e70 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:20.635430 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-512358bd-a711-4bc1-b33b-9bd60153ba3f req-2cb46dd9-29ac-4c47-8a00-7f0a28024e70 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:20.660269 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-512358bd-a711-4bc1-b33b-9bd60153ba3f req-2cb46dd9-29ac-4c47-8a00-7f0a28024e70 service nova] Creating event network-changed:673fb82d-43c8-4e9f-bf01-47ee2806f33a for instance 9a27dd59-4638-430d-a484-d38ed6fcf923 on hv-cinder-83716 Jun 17 11:45:20.661746 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-512358bd-a711-4bc1-b33b-9bd60153ba3f req-2cb46dd9-29ac-4c47-8a00-7f0a28024e70 service nova] Creating event network-vif-deleted:8539e658-97e4-4b54-88b0-968fec4fe3fa for instance be48aa4e-115e-4d58-8940-f722120f4664 on hv-cinder-83716 Jun 17 11:45:20.683932 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-512358bd-a711-4bc1-b33b-9bd60153ba3f req-2cb46dd9-29ac-4c47-8a00-7f0a28024e70 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.079494 Jun 17 11:45:20.691096 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 236/469] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:45:20.931942 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e7394633-691e-4afc-9f79-22a4a77f3cf4 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Action: 'create', calling method: .version_select at 0x7f9c769a1940>, body: {"keypair": {"name": "tempest-TestShelveInstance-98491439", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpT8yEfRp3HhJaaTe8Rtl+dPQEcRGiPgzIUmEG6V86nbR9u5ItqV0vFQkLb+33mXJIA2MCYZcZo8yF6Qd4CFptekateP+ll1ibYxGzlosqCyUBe2mkVvh+ZIhyWHd9rYg=="}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:45:20.994595 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-e7394633-691e-4afc-9f79-22a4a77f3cf4 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Getting quotas for project f6832cdc6d4e43eb9eae4585ef36e611. Resources: {'key_pairs'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 11:45:21.005926 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-e7394633-691e-4afc-9f79-22a4a77f3cf4 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Getting quotas for user 948450e8b1fb4a85a40fbc0a0dacfdde and project f6832cdc6d4e43eb9eae4585ef36e611. Resources: {'key_pairs'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 11:45:21.169606 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-e7394633-691e-4afc-9f79-22a4a77f3cf4 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.665313 Jun 17 11:45:21.176157 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 234/470] 10.222.0.45 () {60 vars in 1158 bytes} [Fri Jun 17 11:45:20 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:45:21.536985 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-bf018ac8-34d2-46df-be54-e984414997c5 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:21.539700 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-bf018ac8-34d2-46df-be54-e984414997c5 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: be48aa4e-115e-4d58-8940-f722120f4664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:21.556458 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bf018ac8-34d2-46df-be54-e984414997c5 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:21.557300 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bf018ac8-34d2-46df-be54-e984414997c5 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:21.558751 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bf018ac8-34d2-46df-be54-e984414997c5 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:21.560608 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bf018ac8-34d2-46df-be54-e984414997c5 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:21.688254 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bf018ac8-34d2-46df-be54-e984414997c5 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:21.693081 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bf018ac8-34d2-46df-be54-e984414997c5 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:21.695731 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-bf018ac8-34d2-46df-be54-e984414997c5 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lazy-loading 'fault' on Instance uuid be48aa4e-115e-4d58-8940-f722120f4664 {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:45:22.220346 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-bf018ac8-34d2-46df-be54-e984414997c5 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:22.231536 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-bf018ac8-34d2-46df-be54-e984414997c5 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664" status: 200 len: 1331 microversion: 2.1 time: 0.700650 Jun 17 11:45:22.232969 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 237/471] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:21 2022] GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664 => generated 1331 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:22.726689 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c48c251f-83f2-488e-aaa1-256d0d34b0e6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:22.727277 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c48c251f-83f2-488e-aaa1-256d0d34b0e6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:22.743981 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c48c251f-83f2-488e-aaa1-256d0d34b0e6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:22.744683 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c48c251f-83f2-488e-aaa1-256d0d34b0e6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:22.745921 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c48c251f-83f2-488e-aaa1-256d0d34b0e6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:22.746528 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c48c251f-83f2-488e-aaa1-256d0d34b0e6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:22.803842 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c48c251f-83f2-488e-aaa1-256d0d34b0e6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972/os-volume_attachments/5826925a-d75a-439d-971f-45ff9bf4d864" status: 200 len: 194 microversion: 2.20 time: 0.081719 Jun 17 11:45:22.805218 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 235/472] 10.222.0.45 () {60 vars in 1453 bytes} [Fri Jun 17 11:45:22 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972/os-volume_attachments/5826925a-d75a-439d-971f-45ff9bf4d864 => generated 194 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 11:45:22.944394 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4becf920-5e81-4726-9c91-089017cae8dd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:22.945278 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4becf920-5e81-4726-9c91-089017cae8dd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:22.952601 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4becf920-5e81-4726-9c91-089017cae8dd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:22.953492 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4becf920-5e81-4726-9c91-089017cae8dd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:22.954571 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4becf920-5e81-4726-9c91-089017cae8dd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:22.955503 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4becf920-5e81-4726-9c91-089017cae8dd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:23.070124 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-4becf920-5e81-4726-9c91-089017cae8dd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lazy-loading 'services' on Instance uuid 71050501-8f84-4701-a013-bfc7a4459972 {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:45:23.260292 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-df0d7048-3ffe-4ba8-950b-52f421210286 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:23.261295 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-df0d7048-3ffe-4ba8-950b-52f421210286 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: be48aa4e-115e-4d58-8940-f722120f4664] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:23.272087 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-df0d7048-3ffe-4ba8-950b-52f421210286 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:23.272611 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-df0d7048-3ffe-4ba8-950b-52f421210286 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:23.273561 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-df0d7048-3ffe-4ba8-950b-52f421210286 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:23.275048 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-df0d7048-3ffe-4ba8-950b-52f421210286 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:23.298332 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-df0d7048-3ffe-4ba8-950b-52f421210286 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] HTTP exception thrown: Instance be48aa4e-115e-4d58-8940-f722120f4664 could not be found. Jun 17 11:45:23.300181 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-df0d7048-3ffe-4ba8-950b-52f421210286 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Request method failure captured: Jun 17 11:45:23.300181 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664 HTTP/1.1 Jun 17 11:45:23.300181 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jun 17 11:45:23.300181 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jun 17 11:45:23.300181 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Connection: close Jun 17 11:45:23.300181 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jun 17 11:45:23.300181 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jun 17 11:45:23.300181 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.45 Jun 17 11:45:23.300181 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jun 17 11:45:23.300181 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jun 17 11:45:23.300181 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABirGhbQZN58Mc4zyhUveG-Q-SFsZYiqbX0gxyltnPVCjSfEYNyfXfhfVCx5KdbK5qhE4EnaiOrUEMOKAhCCD_-tiKGRwJFUZvlEPvpBXY3_SY-UVihK6NaeFSNbrNpsHezSsj02ro8zcS2-cKoHlRfS3nCqLWBYJ5x0JyaHmYJlkw7b68 Jun 17 11:45:23.300181 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jun 17 11:45:23.300181 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jun 17 11:45:23.300181 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jun 17 11:45:23.300181 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jun 17 11:45:23.300181 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jun 17 11:45:23.300181 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jun 17 11:45:23.300181 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Id: c58cf63264414f30a98161f6027daad0 Jun 17 11:45:23.300181 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:45:23.300181 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jun 17 11:45:23.300181 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jun 17 11:45:23.301867 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c58cf63264414f30a98161f6027daad0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c58cf63264414f30a98161f6027daad0", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c58cf63264414f30a98161f6027daad0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c58cf63264414f30a98161f6027daad0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:45:23.301867 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:45:23.301867 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: c58cf63264414f30a98161f6027daad0 Jun 17 11:45:23.301867 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:45:23.301867 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User: tempest-AttachVolumeNegativeTest-1942846496-project Jun 17 11:45:23.301867 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jun 17 11:45:23.301867 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jun 17 11:45:23.301867 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Id: 2e58eacbbb9e41fdbbb13f5b39be782a Jun 17 11:45:23.301867 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-AttachVolumeNegativeTest-1942846496-project Jun 17 11:45:23.301867 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: method: > Jun 17 11:45:23.301867 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: exception: Instance be48aa4e-115e-4d58-8940-f722120f4664 could not be found. Jun 17 11:45:23.301867 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: action_args: {'id': 'be48aa4e-115e-4d58-8940-f722120f4664'} Jun 17 11:45:23.302790 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:45:23.302790 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:45:23.302790 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:45:23.302790 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:45:23.302790 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:45:23.302790 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:45:23.302790 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:45:23.302790 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:45:23.302790 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:45:23.302790 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:45:23.302790 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be48aa4e-115e-4d58-8940-f722120f4664 could not be found. Jun 17 11:45:23.302790 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:45:23.302790 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:45:23.302790 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:45:23.302790 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:45:23.302790 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:45:23.302790 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:45:23.302790 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:45:23.302790 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:45:23.302790 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:45:23.305046 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:45:23.305046 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 11:45:23.305046 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 11:45:23.305046 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:45:23.305046 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:45:23.305046 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:45:23.305046 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:45:23.305046 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be48aa4e-115e-4d58-8940-f722120f4664 could not be found. Jun 17 11:45:23.305046 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:45:23.305046 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:45:23.305046 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:45:23.305046 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:45:23.305046 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:45:23.305046 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:45:23.305046 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:45:23.305046 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:45:23.305046 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be48aa4e-115e-4d58-8940-f722120f4664 could not be found. Jun 17 11:45:23.305046 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:45:23.306793 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-df0d7048-3ffe-4ba8-950b-52f421210286 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Returning 404 to user: Instance be48aa4e-115e-4d58-8940-f722120f4664 could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:45:23.306793 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-df0d7048-3ffe-4ba8-950b-52f421210286 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664" status: 404 len: 111 microversion: 2.1 time: 0.045725 Jun 17 11:45:23.306793 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 236/473] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:23 2022] GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 11:45:23.322657 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-231f4fa2-225a-4b44-bdcd-d4c85277a9e3 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '.version_select at 0x7f9c769a1f70>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:23.608532 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-231f4fa2-225a-4b44-bdcd-d4c85277a9e3 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-801864130" status: 202 len: 0 microversion: 2.1 time: 0.300407 Jun 17 11:45:23.609525 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 237/474] 10.222.0.45 () {58 vars in 1217 bytes} [Fri Jun 17 11:45:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-801864130 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 11:45:23.641936 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4becf920-5e81-4726-9c91-089017cae8dd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "DELETE /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972/os-volume_attachments/5826925a-d75a-439d-971f-45ff9bf4d864" status: 202 len: 0 microversion: 2.20 time: 0.701519 Jun 17 11:45:23.642584 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 238/475] 10.222.0.45 () {60 vars in 1456 bytes} [Fri Jun 17 11:45:22 2022] DELETE /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972/os-volume_attachments/5826925a-d75a-439d-971f-45ff9bf4d864 => generated 0 bytes in 703 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 17 11:45:23.654301 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9346c03c-d548-479a-90d4-919b63790a55 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:23.655240 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9346c03c-d548-479a-90d4-919b63790a55 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:23.666285 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9346c03c-d548-479a-90d4-919b63790a55 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:23.667428 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9346c03c-d548-479a-90d4-919b63790a55 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:23.681674 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9346c03c-d548-479a-90d4-919b63790a55 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:23.681674 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9346c03c-d548-479a-90d4-919b63790a55 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:23.741511 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9346c03c-d548-479a-90d4-919b63790a55 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.093425 Jun 17 11:45:23.750572 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 238/476] 10.222.0.45 () {60 vars in 1342 bytes} [Fri Jun 17 11:45:23 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 11:45:24.761624 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8ca287c3-290e-422d-b507-dbe51218cb5f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:24.763267 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-8ca287c3-290e-422d-b507-dbe51218cb5f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:24.782068 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8ca287c3-290e-422d-b507-dbe51218cb5f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:24.782772 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8ca287c3-290e-422d-b507-dbe51218cb5f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:24.784020 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8ca287c3-290e-422d-b507-dbe51218cb5f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:24.784839 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8ca287c3-290e-422d-b507-dbe51218cb5f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:24.848886 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-8ca287c3-290e-422d-b507-dbe51218cb5f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.091814 Jun 17 11:45:24.856215 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 239/477] 10.222.0.45 () {60 vars in 1342 bytes} [Fri Jun 17 11:45:24 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 11:45:25.104891 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-15d1fd4a-40d4-47f3-8844-d38ff91e6b49 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Action: 'create', calling method: .version_select at 0x7f9c769a1820>, body: {"keypair": {"name": "tempest-keypair-695579830", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtRSkWA3kEs3L/ZMCkXR52xdVjxBiqSbkzN6uuSrlEu45HbxOUhbjxtXrb33yyZm1AKmWzbCw47OB8p94Q5hGJWsCcdz+jubp7yMJVSCZIPg2ZddSb3GbWO5Q0DhKGQbA=="}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:45:25.139970 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-15d1fd4a-40d4-47f3-8844-d38ff91e6b49 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Getting quotas for project c58cf63264414f30a98161f6027daad0. Resources: {'key_pairs'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 11:45:25.149225 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-15d1fd4a-40d4-47f3-8844-d38ff91e6b49 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Getting quotas for user 2e58eacbbb9e41fdbbb13f5b39be782a and project c58cf63264414f30a98161f6027daad0. Resources: {'key_pairs'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 11:45:25.308138 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-15d1fd4a-40d4-47f3-8844-d38ff91e6b49 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.211821 Jun 17 11:45:25.316965 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 239/478] 10.222.0.45 () {60 vars in 1158 bytes} [Fri Jun 17 11:45:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:45:25.866354 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-be83fcca-bb0e-41c2-ba67-a5aa6a2cffd6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:25.870389 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-be83fcca-bb0e-41c2-ba67-a5aa6a2cffd6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:25.884411 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-be83fcca-bb0e-41c2-ba67-a5aa6a2cffd6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:25.885167 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-be83fcca-bb0e-41c2-ba67-a5aa6a2cffd6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:25.886161 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-be83fcca-bb0e-41c2-ba67-a5aa6a2cffd6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:25.887849 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-be83fcca-bb0e-41c2-ba67-a5aa6a2cffd6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:26.033902 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-be83fcca-bb0e-41c2-ba67-a5aa6a2cffd6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.172607 Jun 17 11:45:26.037407 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 240/479] 10.222.0.45 () {60 vars in 1342 bytes} [Fri Jun 17 11:45:25 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972/os-volume_attachments => generated 25 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:26.164187 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-78fd0dc2-9014-4e8f-83c5-b29685db84cb tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:26.165770 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-78fd0dc2-9014-4e8f-83c5-b29685db84cb tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:26.176937 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-78fd0dc2-9014-4e8f-83c5-b29685db84cb tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:26.177768 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-78fd0dc2-9014-4e8f-83c5-b29685db84cb tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:26.178802 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-78fd0dc2-9014-4e8f-83c5-b29685db84cb tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:26.179527 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-78fd0dc2-9014-4e8f-83c5-b29685db84cb tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:26.218075 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-78fd0dc2-9014-4e8f-83c5-b29685db84cb tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Going to try to terminate instance {{(pid=124845) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 11:45:26.735614 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-78fd0dc2-9014-4e8f-83c5-b29685db84cb tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "DELETE /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 204 len: 0 microversion: 2.20 time: 0.574474 Jun 17 11:45:26.740677 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 240/480] 10.222.0.45 () {60 vars in 1279 bytes} [Fri Jun 17 11:45:26 2022] DELETE /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 17 11:45:26.749101 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ab03524e-30a7-4089-b0c3-72964ec1d48a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:26.751308 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ab03524e-30a7-4089-b0c3-72964ec1d48a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:26.763410 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ab03524e-30a7-4089-b0c3-72964ec1d48a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:26.764661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ab03524e-30a7-4089-b0c3-72964ec1d48a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:26.766549 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ab03524e-30a7-4089-b0c3-72964ec1d48a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:26.767717 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ab03524e-30a7-4089-b0c3-72964ec1d48a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:26.990061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ab03524e-30a7-4089-b0c3-72964ec1d48a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:27.000584 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ab03524e-30a7-4089-b0c3-72964ec1d48a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:27.002634 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ab03524e-30a7-4089-b0c3-72964ec1d48a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:27.004060 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ab03524e-30a7-4089-b0c3-72964ec1d48a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1723 microversion: 2.20 time: 0.262460 Jun 17 11:45:27.005330 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 241/481] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:45:26 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:45:28.023831 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-81267694-86df-4141-926d-98127e5af3dd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:28.024467 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-81267694-86df-4141-926d-98127e5af3dd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:28.031075 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-81267694-86df-4141-926d-98127e5af3dd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:28.032150 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-81267694-86df-4141-926d-98127e5af3dd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:28.032925 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-81267694-86df-4141-926d-98127e5af3dd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:28.033355 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-81267694-86df-4141-926d-98127e5af3dd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:28.195717 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-81267694-86df-4141-926d-98127e5af3dd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:28.204608 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-81267694-86df-4141-926d-98127e5af3dd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:28.206090 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-81267694-86df-4141-926d-98127e5af3dd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:28.207267 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-81267694-86df-4141-926d-98127e5af3dd tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1723 microversion: 2.20 time: 0.188045 Jun 17 11:45:28.207861 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 241/482] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:45:28 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:45:29.165319 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-399ab9c3-caac-4149-86e7-3b0a794cb913 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-329702194", "imageRef": "272eb2b7-ddf0-433f-8be8-cdc13c01be77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "562be4fa-7f02-4e16-ab0e-484de596db99"}], "security_groups": [{"name": "tempest-securitygroup--306126364"}], "key_name": "tempest-keypair-695579830", "user_data": "}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:45:29.226278 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-3391c03c-e7f2-497a-bfe1-5695b0708e6f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:29.228071 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-3391c03c-e7f2-497a-bfe1-5695b0708e6f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:29.237099 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3391c03c-e7f2-497a-bfe1-5695b0708e6f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:29.237619 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3391c03c-e7f2-497a-bfe1-5695b0708e6f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:29.239274 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3391c03c-e7f2-497a-bfe1-5695b0708e6f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:29.239968 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3391c03c-e7f2-497a-bfe1-5695b0708e6f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:29.363913 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-3391c03c-e7f2-497a-bfe1-5695b0708e6f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:29.373211 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-3391c03c-e7f2-497a-bfe1-5695b0708e6f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:29.374747 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-3391c03c-e7f2-497a-bfe1-5695b0708e6f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:29.377444 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-3391c03c-e7f2-497a-bfe1-5695b0708e6f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 200 len: 1655 microversion: 2.20 time: 0.155362 Jun 17 11:45:29.389284 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 242/483] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:45:29 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 1655 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:45:29.608999 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-49641fbd-fdf4-4b90-8309-15f4f4e7098a req-a575ab25-55f7-4c1e-99d2-4d0a088fe60e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71050501-8f84-4701-a013-bfc7a4459972", "name": "network-vif-deleted", "tag": "4f9d2fad-e808-44df-adda-539bddcec93d"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:45:29.619439 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-49641fbd-fdf4-4b90-8309-15f4f4e7098a req-a575ab25-55f7-4c1e-99d2-4d0a088fe60e service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:29.620413 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-49641fbd-fdf4-4b90-8309-15f4f4e7098a req-a575ab25-55f7-4c1e-99d2-4d0a088fe60e service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:29.637776 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-49641fbd-fdf4-4b90-8309-15f4f4e7098a req-a575ab25-55f7-4c1e-99d2-4d0a088fe60e service nova] Creating event network-vif-deleted:4f9d2fad-e808-44df-adda-539bddcec93d for instance 71050501-8f84-4701-a013-bfc7a4459972 on hv-cinder-83716 Jun 17 11:45:29.647416 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-49641fbd-fdf4-4b90-8309-15f4f4e7098a req-a575ab25-55f7-4c1e-99d2-4d0a088fe60e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039221 Jun 17 11:45:29.649202 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 243/484] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:45:30.168593 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6e90bb8a-9bb0-4c54-bdf0-d9cc45d49594 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Action: 'create', calling method: .version_select at 0x7f9c769a1ca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-852378024", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfoMLJGk8erP8MfCbKgFjd1cGcHzfvurJw/hhmLRKQcuCOvaZx7HYGulA4dDVmjC4RG81aKTtn+8WR1uVhkHbLjWY4LWhyrd9pIIpMZr6lCChYIzzz0rXl+6ob/W4l5bw=="}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:45:30.185934 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-6e90bb8a-9bb0-4c54-bdf0-d9cc45d49594 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Getting quotas for project 6466d6627209487ca62377eb7aa5d9e4. Resources: {'key_pairs'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 11:45:30.194564 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-6e90bb8a-9bb0-4c54-bdf0-d9cc45d49594 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Getting quotas for user ac50aafcdf92434ba0ef7c8f42642ebb and project 6466d6627209487ca62377eb7aa5d9e4. Resources: {'key_pairs'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 11:45:30.208406 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:45:30.273308 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.network.neutron [None req-399ab9c3-caac-4149-86e7-3b0a794cb913 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] validate_networks() for [('562be4fa-7f02-4e16-ab0e-484de596db99', None, None, None, None, None)] {{(pid=124844) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 11:45:30.324076 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-6e90bb8a-9bb0-4c54-bdf0-d9cc45d49594 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.159774 Jun 17 11:45:30.324963 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 244/485] 10.222.0.45 () {60 vars in 1158 bytes} [Fri Jun 17 11:45:30 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:45:30.385771 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-55fecd50-35c6-4ac7-8c85-e611c8780a4f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-139268533", "imageRef": "f7121e8d-2deb-4ab4-8f4f-bc48a659f0a4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-852378024", "networks": [{"uuid": "8466ff83-1798-416f-b100-eb5c1e5d2fe0"}]}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:45:30.441619 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.network.neutron [None req-55fecd50-35c6-4ac7-8c85-e611c8780a4f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] validate_networks() for [('8466ff83-1798-416f-b100-eb5c1e5d2fe0', None, None, None, None, None)] {{(pid=124845) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 11:45:30.908643 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-399ab9c3-caac-4149-86e7-3b0a794cb913 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Flavor limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 11:45:30.909431 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-399ab9c3-caac-4149-86e7-3b0a794cb913 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Image limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 11:45:30.910309 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-399ab9c3-caac-4149-86e7-3b0a794cb913 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Flavor pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 11:45:30.911101 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-399ab9c3-caac-4149-86e7-3b0a794cb913 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Image pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 11:45:30.911949 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-399ab9c3-caac-4149-86e7-3b0a794cb913 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 11:45:30.929145 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-399ab9c3-caac-4149-86e7-3b0a794cb913 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:30.929145 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-399ab9c3-caac-4149-86e7-3b0a794cb913 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:30.932217 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-399ab9c3-caac-4149-86e7-3b0a794cb913 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:30.933052 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-399ab9c3-caac-4149-86e7-3b0a794cb913 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:30.965328 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-399ab9c3-caac-4149-86e7-3b0a794cb913 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Getting quotas for project c58cf63264414f30a98161f6027daad0. Resources: {'instances', 'ram', 'cores'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 11:45:30.972792 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-399ab9c3-caac-4149-86e7-3b0a794cb913 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Getting quotas for user 2e58eacbbb9e41fdbbb13f5b39be782a and project c58cf63264414f30a98161f6027daad0. Resources: {'instances', 'ram', 'cores'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 11:45:30.998395 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-399ab9c3-caac-4149-86e7-3b0a794cb913 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Going to run 1 instances... {{(pid=124844) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 11:45:31.001545 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-399ab9c3-caac-4149-86e7-3b0a794cb913 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='272eb2b7-ddf0-433f-8be8-cdc13c01be77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 11:45:31.084819 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-55fecd50-35c6-4ac7-8c85-e611c8780a4f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Flavor limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 11:45:31.085242 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-55fecd50-35c6-4ac7-8c85-e611c8780a4f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Image limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 11:45:31.085733 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-55fecd50-35c6-4ac7-8c85-e611c8780a4f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Flavor pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 11:45:31.086136 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-55fecd50-35c6-4ac7-8c85-e611c8780a4f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Image pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 11:45:31.086536 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-55fecd50-35c6-4ac7-8c85-e611c8780a4f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 11:45:31.097006 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-55fecd50-35c6-4ac7-8c85-e611c8780a4f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:31.097452 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-55fecd50-35c6-4ac7-8c85-e611c8780a4f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:31.098292 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-55fecd50-35c6-4ac7-8c85-e611c8780a4f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:31.098750 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-55fecd50-35c6-4ac7-8c85-e611c8780a4f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:31.117531 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-55fecd50-35c6-4ac7-8c85-e611c8780a4f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Getting quotas for project 6466d6627209487ca62377eb7aa5d9e4. Resources: {'instances', 'ram', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 11:45:31.128374 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-55fecd50-35c6-4ac7-8c85-e611c8780a4f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Getting quotas for user ac50aafcdf92434ba0ef7c8f42642ebb and project 6466d6627209487ca62377eb7aa5d9e4. Resources: {'instances', 'ram', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 11:45:31.135676 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-55fecd50-35c6-4ac7-8c85-e611c8780a4f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Going to run 1 instances... {{(pid=124845) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 11:45:31.138124 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-55fecd50-35c6-4ac7-8c85-e611c8780a4f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7121e8d-2deb-4ab4-8f4f-bc48a659f0a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 11:45:31.273415 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-399ab9c3-caac-4149-86e7-3b0a794cb913 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.112282 Jun 17 11:45:31.274057 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 242/486] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 17 11:45:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 2114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 11:45:31.278645 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4e4c93a4-5e75-4692-ab31-59f254967230 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:31.279324 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4e4c93a4-5e75-4692-ab31-59f254967230 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:31.285780 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4e4c93a4-5e75-4692-ab31-59f254967230 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:31.286223 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4e4c93a4-5e75-4692-ab31-59f254967230 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:31.287045 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4e4c93a4-5e75-4692-ab31-59f254967230 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:31.287555 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4e4c93a4-5e75-4692-ab31-59f254967230 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:31.305079 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-4e4c93a4-5e75-4692-ab31-59f254967230 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] HTTP exception thrown: Instance 71050501-8f84-4701-a013-bfc7a4459972 could not be found. Jun 17 11:45:31.306803 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4e4c93a4-5e75-4692-ab31-59f254967230 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Request method failure captured: Jun 17 11:45:31.306803 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: request: GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 HTTP/1.1 Jun 17 11:45:31.306803 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept: application/json Jun 17 11:45:31.306803 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jun 17 11:45:31.306803 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Connection: close Jun 17 11:45:31.306803 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jun 17 11:45:31.306803 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jun 17 11:45:31.306803 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Host: 10.222.0.45 Jun 17 11:45:31.306803 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jun 17 11:45:31.306803 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jun 17 11:45:31.306803 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABirGhbyTP6m8A6ocgcmCTbD2vtB5wliIaOyA8S7K2P96o-JRntRfJUSSZ-WD1QB-eTMm9Rz6lGJCOx-RLb0Rcq3CsQFid38C6tit0d8QF69DexK2qxFSYg5BUKaBJV8YlN8x7PJ8SeLm0KommhoQlq6Zz2O8A6Hy2IuR2pqoxEMVsxlg0 Jun 17 11:45:31.306803 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jun 17 11:45:31.306803 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jun 17 11:45:31.306803 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jun 17 11:45:31.306803 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jun 17 11:45:31.306803 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 11:45:31.306803 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jun 17 11:45:31.306803 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jun 17 11:45:31.306803 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Id: bc8dc1335e284eee8cca45d5720d5f16 Jun 17 11:45:31.306803 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1476822038 Jun 17 11:45:31.306803 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Role: member,reader Jun 17 11:45:31.306803 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Roles: member,reader Jun 17 11:45:31.308436 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bc8dc1335e284eee8cca45d5720d5f16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bc8dc1335e284eee8cca45d5720d5f16", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bc8dc1335e284eee8cca45d5720d5f16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bc8dc1335e284eee8cca45d5720d5f16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:45:31.308436 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1476822038 Jun 17 11:45:31.308436 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Id: bc8dc1335e284eee8cca45d5720d5f16 Jun 17 11:45:31.308436 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1476822038 Jun 17 11:45:31.308436 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User: tempest-AttachVolumeShelveTestJSON-1476822038-project Jun 17 11:45:31.308436 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jun 17 11:45:31.308436 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jun 17 11:45:31.308436 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Id: d817bad669fc4d6f829bf6eb57773b23 Jun 17 11:45:31.308436 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1476822038-project Jun 17 11:45:31.308436 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: method: > Jun 17 11:45:31.308436 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: exception: Instance 71050501-8f84-4701-a013-bfc7a4459972 could not be found. Jun 17 11:45:31.308436 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: action_args: {'id': '71050501-8f84-4701-a013-bfc7a4459972'} Jun 17 11:45:31.309266 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:45:31.309266 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:45:31.309266 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:45:31.309266 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:45:31.309266 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:45:31.309266 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:45:31.309266 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:45:31.309266 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:45:31.309266 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:45:31.309266 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:45:31.309266 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71050501-8f84-4701-a013-bfc7a4459972 could not be found. Jun 17 11:45:31.309266 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:45:31.309266 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:45:31.309266 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:45:31.309266 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:45:31.309266 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:45:31.309266 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:45:31.309266 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:45:31.309266 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:45:31.309266 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:45:31.311532 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:45:31.311532 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 11:45:31.311532 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 11:45:31.311532 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:45:31.311532 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:45:31.311532 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:45:31.311532 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:45:31.311532 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71050501-8f84-4701-a013-bfc7a4459972 could not be found. Jun 17 11:45:31.311532 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:45:31.311532 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:45:31.311532 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:45:31.311532 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:45:31.311532 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:45:31.311532 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:45:31.311532 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:45:31.311532 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:45:31.311532 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71050501-8f84-4701-a013-bfc7a4459972 could not be found. Jun 17 11:45:31.311532 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:45:31.313778 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4e4c93a4-5e75-4692-ab31-59f254967230 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Returning 404 to user: Instance 71050501-8f84-4701-a013-bfc7a4459972 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:45:31.313778 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4e4c93a4-5e75-4692-ab31-59f254967230 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 404 len: 111 microversion: 2.20 time: 0.033310 Jun 17 11:45:31.313778 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 243/487] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:45:31 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 11:45:31.314169 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-df84f8fa-e5d0-4c0c-8898-b97cb4b76d87 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:31.314705 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-df84f8fa-e5d0-4c0c-8898-b97cb4b76d87 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:31.334827 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-55fecd50-35c6-4ac7-8c85-e611c8780a4f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.957481 Jun 17 11:45:31.336227 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 245/488] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 17 11:45:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 11:45:31.341312 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8b03c1cc-b783-4525-99de-5d5d9480fa60 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '.version_select at 0x7f9c76a38790>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:31.379894 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-df84f8fa-e5d0-4c0c-8898-b97cb4b76d87 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:31.387626 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-df84f8fa-e5d0-4c0c-8898-b97cb4b76d87 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b" status: 200 len: 1240 microversion: 2.1 time: 0.077723 Jun 17 11:45:31.388218 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 244/489] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:31 2022] GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b => generated 1240 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:31.393422 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ed640b29-ad06-428e-ab8c-7e53a3bbd38e tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:31.394239 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ed640b29-ad06-428e-ab8c-7e53a3bbd38e tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:31.433027 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-8b03c1cc-b783-4525-99de-5d5d9480fa60 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1601128479" status: 204 len: 0 microversion: 2.20 time: 0.094049 Jun 17 11:45:31.434781 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 246/490] 10.222.0.45 () {60 vars in 1261 bytes} [Fri Jun 17 11:45:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1601128479 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 17 11:45:31.465588 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ed640b29-ad06-428e-ab8c-7e53a3bbd38e tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:31.479132 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ed640b29-ad06-428e-ab8c-7e53a3bbd38e tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1257 microversion: 2.1 time: 0.089366 Jun 17 11:45:31.479831 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 245/491] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:31 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1257 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:32.385249 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-647ea1bb-9444-4b14-b7e9-c60e4cd0062c tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Action: 'create', calling method: .version_select at 0x7f9c769a00d0>, body: {"keypair": {"name": "tempest-keypair-1606076017", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEOYB3sjb/YEzs8nYFjwwfOt5+qohsOhXIi3yarupQ/oMyELxY4vcrkagMe/m63G1an6/Ro5mrpan7kqjZvpNGG7+YuY/cN9N40SfNoIaSCqxqkdnekDZZy4QuEDkIOMw=="}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:45:32.400810 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-647ea1bb-9444-4b14-b7e9-c60e4cd0062c tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Getting quotas for project bc8dc1335e284eee8cca45d5720d5f16. Resources: {'key_pairs'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 11:45:32.405177 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-647ea1bb-9444-4b14-b7e9-c60e4cd0062c tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Getting quotas for user d817bad669fc4d6f829bf6eb57773b23 and project bc8dc1335e284eee8cca45d5720d5f16. Resources: {'key_pairs'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 11:45:32.407931 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-7778a8e0-5ab8-4768-95b8-49173d77af8a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:32.408814 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7778a8e0-5ab8-4768-95b8-49173d77af8a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:32.416939 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7778a8e0-5ab8-4768-95b8-49173d77af8a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:32.417698 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7778a8e0-5ab8-4768-95b8-49173d77af8a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:32.418872 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7778a8e0-5ab8-4768-95b8-49173d77af8a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:32.419293 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7778a8e0-5ab8-4768-95b8-49173d77af8a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:32.492064 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7778a8e0-5ab8-4768-95b8-49173d77af8a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:32.503455 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-7778a8e0-5ab8-4768-95b8-49173d77af8a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b" status: 200 len: 1244 microversion: 2.1 time: 0.101447 Jun 17 11:45:32.514574 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 246/492] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:32 2022] GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b => generated 1244 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:45:32.514574 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6fba84fa-af4d-4b67-8f12-ffd43cbdb6fd tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:32.514574 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-6fba84fa-af4d-4b67-8f12-ffd43cbdb6fd tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:32.568080 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-6fba84fa-af4d-4b67-8f12-ffd43cbdb6fd tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:32.575936 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-6fba84fa-af4d-4b67-8f12-ffd43cbdb6fd tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1257 microversion: 2.1 time: 0.070445 Jun 17 11:45:32.576536 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 247/493] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:32 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1257 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:32.584763 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-647ea1bb-9444-4b14-b7e9-c60e4cd0062c tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.203929 Jun 17 11:45:32.586124 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 247/494] 10.222.0.45 () {62 vars in 1199 bytes} [Fri Jun 17 11:45:32 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 206 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 17 11:45:33.524781 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f84fb380-b820-4b42-a046-41a1d7366b71 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:33.525407 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f84fb380-b820-4b42-a046-41a1d7366b71 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:33.534417 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f84fb380-b820-4b42-a046-41a1d7366b71 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:33.535271 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f84fb380-b820-4b42-a046-41a1d7366b71 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:33.537289 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f84fb380-b820-4b42-a046-41a1d7366b71 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:33.537869 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f84fb380-b820-4b42-a046-41a1d7366b71 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:33.593937 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-02697df4-8c61-42a1-8f27-71b207e99bc1 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:33.594559 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-02697df4-8c61-42a1-8f27-71b207e99bc1 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:33.601067 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-02697df4-8c61-42a1-8f27-71b207e99bc1 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:33.601515 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-02697df4-8c61-42a1-8f27-71b207e99bc1 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:33.602430 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-02697df4-8c61-42a1-8f27-71b207e99bc1 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:33.602817 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-02697df4-8c61-42a1-8f27-71b207e99bc1 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:33.623244 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f84fb380-b820-4b42-a046-41a1d7366b71 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:33.632457 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f84fb380-b820-4b42-a046-41a1d7366b71 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b" status: 200 len: 1292 microversion: 2.1 time: 0.111427 Jun 17 11:45:33.633385 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 248/495] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:33 2022] GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b => generated 1292 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:45:33.689403 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-02697df4-8c61-42a1-8f27-71b207e99bc1 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:33.702114 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-02697df4-8c61-42a1-8f27-71b207e99bc1 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1261 microversion: 2.1 time: 0.112598 Jun 17 11:45:33.702809 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 248/496] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:33 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1261 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:45:34.663151 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-83dcc436-378a-48c7-9a63-742774428477 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:34.663965 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-83dcc436-378a-48c7-9a63-742774428477 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:34.674849 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-83dcc436-378a-48c7-9a63-742774428477 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:34.675751 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-83dcc436-378a-48c7-9a63-742774428477 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:34.676660 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-83dcc436-378a-48c7-9a63-742774428477 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:34.677201 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-83dcc436-378a-48c7-9a63-742774428477 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:34.721986 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0ca0f358-6a2b-4cce-b88a-7e02a5c414a4 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:34.722994 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0ca0f358-6a2b-4cce-b88a-7e02a5c414a4 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:34.733784 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0ca0f358-6a2b-4cce-b88a-7e02a5c414a4 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:34.735079 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0ca0f358-6a2b-4cce-b88a-7e02a5c414a4 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:34.736172 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0ca0f358-6a2b-4cce-b88a-7e02a5c414a4 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:34.736681 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0ca0f358-6a2b-4cce-b88a-7e02a5c414a4 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:34.762208 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-83dcc436-378a-48c7-9a63-742774428477 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:34.777636 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-83dcc436-378a-48c7-9a63-742774428477 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b" status: 200 len: 1310 microversion: 2.1 time: 0.118282 Jun 17 11:45:34.778535 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 249/497] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:34 2022] GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b => generated 1310 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:34.840477 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0ca0f358-6a2b-4cce-b88a-7e02a5c414a4 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:34.849789 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0ca0f358-6a2b-4cce-b88a-7e02a5c414a4 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1309 microversion: 2.1 time: 0.133687 Jun 17 11:45:34.851678 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 249/498] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:34 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1309 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:45:35.803710 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-33cb3e25-f820-4dd6-bf56-45f928cf7777 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:35.804324 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-33cb3e25-f820-4dd6-bf56-45f928cf7777 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:35.819074 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-33cb3e25-f820-4dd6-bf56-45f928cf7777 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:35.820234 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-33cb3e25-f820-4dd6-bf56-45f928cf7777 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:35.823110 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-33cb3e25-f820-4dd6-bf56-45f928cf7777 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:35.823876 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-33cb3e25-f820-4dd6-bf56-45f928cf7777 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:35.868224 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ec153f0a-1395-4bcb-a753-1cc156d24b46 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:35.869663 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-ec153f0a-1395-4bcb-a753-1cc156d24b46 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:35.878899 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ec153f0a-1395-4bcb-a753-1cc156d24b46 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:35.879499 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ec153f0a-1395-4bcb-a753-1cc156d24b46 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:35.880171 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ec153f0a-1395-4bcb-a753-1cc156d24b46 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:35.880636 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ec153f0a-1395-4bcb-a753-1cc156d24b46 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:36.017940 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ec153f0a-1395-4bcb-a753-1cc156d24b46 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:36.034349 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-ec153f0a-1395-4bcb-a753-1cc156d24b46 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1315 microversion: 2.1 time: 0.170099 Jun 17 11:45:36.036130 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 250/499] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:35 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:36.054191 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ae622624-f7ca-4048-90d1-bc467682b2a6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-123771121", "imageRef": "272eb2b7-ddf0-433f-8be8-cdc13c01be77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e586d9ae-1ebe-4cac-a969-e5265b9acb47"}], "security_groups": [{"name": "tempest-securitygroup--840405548"}], "key_name": "tempest-keypair-1606076017", "user_data": "}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:45:36.461740 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-33cb3e25-f820-4dd6-bf56-45f928cf7777 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:36.470934 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-33cb3e25-f820-4dd6-bf56-45f928cf7777 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b" status: 200 len: 1365 microversion: 2.1 time: 0.672176 Jun 17 11:45:36.476277 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 250/500] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:35 2022] GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b => generated 1365 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:37.078314 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4e7577c3-baae-4f0d-baff-e9c35158504a tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:37.080971 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4e7577c3-baae-4f0d-baff-e9c35158504a tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:37.106226 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4e7577c3-baae-4f0d-baff-e9c35158504a tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:37.108030 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4e7577c3-baae-4f0d-baff-e9c35158504a tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:37.116507 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4e7577c3-baae-4f0d-baff-e9c35158504a tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:37.118281 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4e7577c3-baae-4f0d-baff-e9c35158504a tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:37.448966 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4e7577c3-baae-4f0d-baff-e9c35158504a tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:37.464561 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4e7577c3-baae-4f0d-baff-e9c35158504a tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1357 microversion: 2.1 time: 0.399526 Jun 17 11:45:37.467499 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 251/501] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:37 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1357 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:37.482864 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-10fa1742-59e6-4c18-bcc3-6e7aac91b810 req-546a8950-dd61-4624-8ac8-c3051618d91b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b705046-ed66-4a09-9354-18ee01d1676b", "tag": "59a1be8f-e417-465c-8536-98f4405514f7"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:45:37.513618 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-10fa1742-59e6-4c18-bcc3-6e7aac91b810 req-546a8950-dd61-4624-8ac8-c3051618d91b service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:37.514559 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-10fa1742-59e6-4c18-bcc3-6e7aac91b810 req-546a8950-dd61-4624-8ac8-c3051618d91b service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:37.534493 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-10fa1742-59e6-4c18-bcc3-6e7aac91b810 req-546a8950-dd61-4624-8ac8-c3051618d91b service nova] Creating event network-changed:59a1be8f-e417-465c-8536-98f4405514f7 for instance 4b705046-ed66-4a09-9354-18ee01d1676b on hv-cinder-83716 Jun 17 11:45:37.549053 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-10fa1742-59e6-4c18-bcc3-6e7aac91b810 req-546a8950-dd61-4624-8ac8-c3051618d91b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079921 Jun 17 11:45:37.550185 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 252/502] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:45:37.555997 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c3bd1c2a-e003-4d22-97ce-5555f702c3d4 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:37.557234 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c3bd1c2a-e003-4d22-97ce-5555f702c3d4 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:37.565645 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c3bd1c2a-e003-4d22-97ce-5555f702c3d4 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:37.566401 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c3bd1c2a-e003-4d22-97ce-5555f702c3d4 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:37.567668 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c3bd1c2a-e003-4d22-97ce-5555f702c3d4 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:37.568314 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c3bd1c2a-e003-4d22-97ce-5555f702c3d4 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:37.574284 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:45:37.998635 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c3bd1c2a-e003-4d22-97ce-5555f702c3d4 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:38.008842 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c3bd1c2a-e003-4d22-97ce-5555f702c3d4 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b" status: 200 len: 1365 microversion: 2.1 time: 0.456999 Jun 17 11:45:38.010184 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 253/503] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:37 2022] GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b => generated 1365 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:38.487861 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b1e04c0f-c855-44e5-b625-e1a47495b067 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:38.490534 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b1e04c0f-c855-44e5-b625-e1a47495b067 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:38.512560 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b1e04c0f-c855-44e5-b625-e1a47495b067 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:38.518595 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b1e04c0f-c855-44e5-b625-e1a47495b067 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:38.518595 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b1e04c0f-c855-44e5-b625-e1a47495b067 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:38.518595 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b1e04c0f-c855-44e5-b625-e1a47495b067 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:38.832131 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.network.neutron [None req-ae622624-f7ca-4048-90d1-bc467682b2a6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] validate_networks() for [('e586d9ae-1ebe-4cac-a969-e5265b9acb47', None, None, None, None, None)] {{(pid=124845) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 11:45:38.978952 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b1e04c0f-c855-44e5-b625-e1a47495b067 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:38.997269 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b1e04c0f-c855-44e5-b625-e1a47495b067 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1357 microversion: 2.1 time: 0.513264 Jun 17 11:45:38.998493 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 254/504] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:38 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1357 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:39.030355 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-cc85a39a-d2b0-4777-a0c2-1783394b2e10 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:39.031072 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-cc85a39a-d2b0-4777-a0c2-1783394b2e10 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:39.044660 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cc85a39a-d2b0-4777-a0c2-1783394b2e10 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:39.045707 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cc85a39a-d2b0-4777-a0c2-1783394b2e10 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:39.047798 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cc85a39a-d2b0-4777-a0c2-1783394b2e10 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:39.048750 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cc85a39a-d2b0-4777-a0c2-1783394b2e10 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:39.431853 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-cc85a39a-d2b0-4777-a0c2-1783394b2e10 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:39.455225 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-cc85a39a-d2b0-4777-a0c2-1783394b2e10 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b" status: 200 len: 1365 microversion: 2.1 time: 0.428776 Jun 17 11:45:39.459610 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 255/505] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:39 2022] GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b => generated 1365 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:45:39.586700 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-919baff4-7994-472d-a378-39db916030d3 req-3cc096b7-bae5-4130-bf29-b95b0cd279a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907", "tag": "f866082a-76d6-466b-8c49-7a5068d4d87f"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:45:39.606700 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-919baff4-7994-472d-a378-39db916030d3 req-3cc096b7-bae5-4130-bf29-b95b0cd279a0 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:39.607358 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-919baff4-7994-472d-a378-39db916030d3 req-3cc096b7-bae5-4130-bf29-b95b0cd279a0 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:39.636512 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-919baff4-7994-472d-a378-39db916030d3 req-3cc096b7-bae5-4130-bf29-b95b0cd279a0 service nova] Creating event network-changed:f866082a-76d6-466b-8c49-7a5068d4d87f for instance 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 on hv-cinder-83716 Jun 17 11:45:39.650043 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-919baff4-7994-472d-a378-39db916030d3 req-3cc096b7-bae5-4130-bf29-b95b0cd279a0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061355 Jun 17 11:45:39.652055 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 256/506] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:45:39.886327 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-ae622624-f7ca-4048-90d1-bc467682b2a6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Flavor limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 11:45:39.886936 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-ae622624-f7ca-4048-90d1-bc467682b2a6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Image limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 11:45:39.887306 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-ae622624-f7ca-4048-90d1-bc467682b2a6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Flavor pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 11:45:39.887881 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-ae622624-f7ca-4048-90d1-bc467682b2a6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Image pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 11:45:39.888562 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-ae622624-f7ca-4048-90d1-bc467682b2a6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 11:45:39.901357 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ae622624-f7ca-4048-90d1-bc467682b2a6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:39.902175 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ae622624-f7ca-4048-90d1-bc467682b2a6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:39.903438 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ae622624-f7ca-4048-90d1-bc467682b2a6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:39.904110 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ae622624-f7ca-4048-90d1-bc467682b2a6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:39.928459 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-ae622624-f7ca-4048-90d1-bc467682b2a6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Getting quotas for project bc8dc1335e284eee8cca45d5720d5f16. Resources: {'instances', 'ram', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 11:45:39.934476 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-ae622624-f7ca-4048-90d1-bc467682b2a6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Getting quotas for user d817bad669fc4d6f829bf6eb57773b23 and project bc8dc1335e284eee8cca45d5720d5f16. Resources: {'instances', 'ram', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 11:45:39.950071 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-ae622624-f7ca-4048-90d1-bc467682b2a6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Going to run 1 instances... {{(pid=124845) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 11:45:39.952620 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-ae622624-f7ca-4048-90d1-bc467682b2a6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='272eb2b7-ddf0-433f-8be8-cdc13c01be77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 11:45:40.020694 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-84913187-0862-482b-b2b6-6f7c9b1daaa6 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:40.021776 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-84913187-0862-482b-b2b6-6f7c9b1daaa6 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:40.030162 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-84913187-0862-482b-b2b6-6f7c9b1daaa6 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:40.030621 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-84913187-0862-482b-b2b6-6f7c9b1daaa6 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:40.032183 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-84913187-0862-482b-b2b6-6f7c9b1daaa6 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:40.032792 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-84913187-0862-482b-b2b6-6f7c9b1daaa6 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:40.130495 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-ae622624-f7ca-4048-90d1-bc467682b2a6 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.092836 Jun 17 11:45:40.131172 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 251/507] 10.222.0.45 () {62 vars in 1187 bytes} [Fri Jun 17 11:45:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 4094 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 17 11:45:40.143687 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c30747c2-6880-4e46-902b-578894be5ef0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:40.144473 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c30747c2-6880-4e46-902b-578894be5ef0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:40.236574 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c30747c2-6880-4e46-902b-578894be5ef0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:40.247038 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c30747c2-6880-4e46-902b-578894be5ef0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:40.248871 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c30747c2-6880-4e46-902b-578894be5ef0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:40.250640 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-84913187-0862-482b-b2b6-6f7c9b1daaa6 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:40.250868 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c30747c2-6880-4e46-902b-578894be5ef0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1281 microversion: 2.20 time: 0.111610 Jun 17 11:45:40.252318 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 252/508] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:45:40 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1281 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:45:40.275066 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-84913187-0862-482b-b2b6-6f7c9b1daaa6 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1357 microversion: 2.1 time: 0.259617 Jun 17 11:45:40.286117 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 257/509] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:40 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1357 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:40.493219 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-1a6325c8-55a4-4943-bd9e-ba1774c37e75 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:40.494919 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-1a6325c8-55a4-4943-bd9e-ba1774c37e75 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:40.507021 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1a6325c8-55a4-4943-bd9e-ba1774c37e75 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:40.508510 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1a6325c8-55a4-4943-bd9e-ba1774c37e75 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:40.510020 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1a6325c8-55a4-4943-bd9e-ba1774c37e75 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:40.510762 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1a6325c8-55a4-4943-bd9e-ba1774c37e75 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:40.756585 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-1a6325c8-55a4-4943-bd9e-ba1774c37e75 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:40.756585 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:45:40.774789 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-1a6325c8-55a4-4943-bd9e-ba1774c37e75 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b" status: 200 len: 1365 microversion: 2.1 time: 0.292449 Jun 17 11:45:40.775405 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 253/510] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:40 2022] GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b => generated 1365 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:41.275757 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-9bfb6f9f-cf5c-460e-860f-7e036d41fdd3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:41.276600 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-9bfb6f9f-cf5c-460e-860f-7e036d41fdd3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:41.278876 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=2 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:45:41.286958 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9bfb6f9f-cf5c-460e-860f-7e036d41fdd3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:41.287977 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9bfb6f9f-cf5c-460e-860f-7e036d41fdd3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:41.288362 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9bfb6f9f-cf5c-460e-860f-7e036d41fdd3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:41.288881 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9bfb6f9f-cf5c-460e-860f-7e036d41fdd3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:41.294503 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-34a46799-ff61-43e1-b562-9a4b5a6dba54 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:41.295673 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-34a46799-ff61-43e1-b562-9a4b5a6dba54 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:41.306273 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-34a46799-ff61-43e1-b562-9a4b5a6dba54 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:41.306729 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-34a46799-ff61-43e1-b562-9a4b5a6dba54 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:41.313151 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-34a46799-ff61-43e1-b562-9a4b5a6dba54 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:41.313814 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-34a46799-ff61-43e1-b562-9a4b5a6dba54 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:41.365113 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-9bfb6f9f-cf5c-460e-860f-7e036d41fdd3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:41.378511 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-9bfb6f9f-cf5c-460e-860f-7e036d41fdd3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:41.380160 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-9bfb6f9f-cf5c-460e-860f-7e036d41fdd3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:41.381323 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-9bfb6f9f-cf5c-460e-860f-7e036d41fdd3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1285 microversion: 2.20 time: 0.109580 Jun 17 11:45:41.381901 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 258/511] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:45:41 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:45:41.496324 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-34a46799-ff61-43e1-b562-9a4b5a6dba54 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:41.504710 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-34a46799-ff61-43e1-b562-9a4b5a6dba54 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1357 microversion: 2.1 time: 0.214918 Jun 17 11:45:41.514073 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 254/512] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:41 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1357 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:41.796182 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d842ecb5-cf43-4440-906b-12257e4349b0 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:41.798713 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d842ecb5-cf43-4440-906b-12257e4349b0 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:41.815337 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d842ecb5-cf43-4440-906b-12257e4349b0 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:41.816761 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d842ecb5-cf43-4440-906b-12257e4349b0 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:41.818032 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d842ecb5-cf43-4440-906b-12257e4349b0 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:41.819073 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d842ecb5-cf43-4440-906b-12257e4349b0 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:42.009396 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d842ecb5-cf43-4440-906b-12257e4349b0 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:42.020208 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d842ecb5-cf43-4440-906b-12257e4349b0 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b" status: 200 len: 1365 microversion: 2.1 time: 0.230163 Jun 17 11:45:42.025688 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 259/513] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:41 2022] GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:42.402540 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-3a1d2d88-3a9c-4c9f-87ba-b41cf0cbaf32 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:42.403317 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-3a1d2d88-3a9c-4c9f-87ba-b41cf0cbaf32 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:42.411124 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3a1d2d88-3a9c-4c9f-87ba-b41cf0cbaf32 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:42.411597 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3a1d2d88-3a9c-4c9f-87ba-b41cf0cbaf32 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:42.412371 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3a1d2d88-3a9c-4c9f-87ba-b41cf0cbaf32 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:42.412803 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3a1d2d88-3a9c-4c9f-87ba-b41cf0cbaf32 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:42.486403 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-3a1d2d88-3a9c-4c9f-87ba-b41cf0cbaf32 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:42.500601 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-3a1d2d88-3a9c-4c9f-87ba-b41cf0cbaf32 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:42.511081 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-3a1d2d88-3a9c-4c9f-87ba-b41cf0cbaf32 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:42.512492 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-3a1d2d88-3a9c-4c9f-87ba-b41cf0cbaf32 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1285 microversion: 2.20 time: 0.114251 Jun 17 11:45:42.513544 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 255/514] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:45:42 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:45:42.522044 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a7307c23-4c38-4c1f-ae90-6c084e4f3924 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:42.522821 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a7307c23-4c38-4c1f-ae90-6c084e4f3924 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:42.530282 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a7307c23-4c38-4c1f-ae90-6c084e4f3924 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:42.531063 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a7307c23-4c38-4c1f-ae90-6c084e4f3924 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:42.532467 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a7307c23-4c38-4c1f-ae90-6c084e4f3924 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:42.533058 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a7307c23-4c38-4c1f-ae90-6c084e4f3924 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:42.582991 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=12 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:45:42.701016 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a7307c23-4c38-4c1f-ae90-6c084e4f3924 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:42.711086 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a7307c23-4c38-4c1f-ae90-6c084e4f3924 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1357 microversion: 2.1 time: 0.192822 Jun 17 11:45:42.712112 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 260/515] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:42 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:43.042222 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-eed18468-a46a-4495-be60-afd364b853c6 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:43.042855 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-eed18468-a46a-4495-be60-afd364b853c6 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:43.051100 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-eed18468-a46a-4495-be60-afd364b853c6 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:43.051583 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-eed18468-a46a-4495-be60-afd364b853c6 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:43.052347 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-eed18468-a46a-4495-be60-afd364b853c6 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:43.052798 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-eed18468-a46a-4495-be60-afd364b853c6 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:43.202730 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-eed18468-a46a-4495-be60-afd364b853c6 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:43.211260 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-eed18468-a46a-4495-be60-afd364b853c6 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b" status: 200 len: 1365 microversion: 2.1 time: 0.172711 Jun 17 11:45:43.211933 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 256/516] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:43 2022] GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:43.541563 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-24f1415b-c099-480b-840c-887cceb7cb1d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:43.542164 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-24f1415b-c099-480b-840c-887cceb7cb1d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:43.556773 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-24f1415b-c099-480b-840c-887cceb7cb1d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:43.557522 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-24f1415b-c099-480b-840c-887cceb7cb1d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:43.558616 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-24f1415b-c099-480b-840c-887cceb7cb1d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:43.559237 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-24f1415b-c099-480b-840c-887cceb7cb1d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:43.639713 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-24f1415b-c099-480b-840c-887cceb7cb1d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:43.649441 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-24f1415b-c099-480b-840c-887cceb7cb1d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:43.651235 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-24f1415b-c099-480b-840c-887cceb7cb1d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:43.652457 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-24f1415b-c099-480b-840c-887cceb7cb1d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1285 microversion: 2.20 time: 0.114955 Jun 17 11:45:43.655960 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 261/517] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:45:43 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:45:43.728765 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c09def82-255b-4105-ba40-ec5505ec497f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:43.729440 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c09def82-255b-4105-ba40-ec5505ec497f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:43.736763 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c09def82-255b-4105-ba40-ec5505ec497f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:43.737219 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c09def82-255b-4105-ba40-ec5505ec497f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:43.738006 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c09def82-255b-4105-ba40-ec5505ec497f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:43.738443 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c09def82-255b-4105-ba40-ec5505ec497f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:43.901128 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c09def82-255b-4105-ba40-ec5505ec497f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:43.910469 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c09def82-255b-4105-ba40-ec5505ec497f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1357 microversion: 2.1 time: 0.185574 Jun 17 11:45:43.911069 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 257/518] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:43 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1357 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:44.067837 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3309b66e-6720-4dac-8749-b282cf1fb31c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1401962942", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-98491439", "security_groups": [{"name": "tempest-secgroup-smoke-752629204"}], "networks": [{"uuid": "29b7df83-bd84-4880-9c95-be54b0ab66a0"}], "block_device_mapping_v2": [{"uuid": "364805d2-1454-44d7-baf0-341865174340", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:45:44.235235 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a4692df3-3188-413e-8c2b-fef3dfd70268 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:44.236476 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a4692df3-3188-413e-8c2b-fef3dfd70268 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:44.247532 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.network.neutron [None req-3309b66e-6720-4dac-8749-b282cf1fb31c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] validate_networks() for [('29b7df83-bd84-4880-9c95-be54b0ab66a0', None, None, None, None, None)] {{(pid=124844) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 11:45:44.264987 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a4692df3-3188-413e-8c2b-fef3dfd70268 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:44.266844 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a4692df3-3188-413e-8c2b-fef3dfd70268 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:44.268782 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a4692df3-3188-413e-8c2b-fef3dfd70268 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:44.269840 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a4692df3-3188-413e-8c2b-fef3dfd70268 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:44.550261 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a4692df3-3188-413e-8c2b-fef3dfd70268 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:44.557699 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a4692df3-3188-413e-8c2b-fef3dfd70268 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b" status: 200 len: 1365 microversion: 2.1 time: 0.331603 Jun 17 11:45:44.558274 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 258/519] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:44 2022] GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b => generated 1365 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:44.674967 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2f6f2a23-6091-4103-baf5-3778b9123cc4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:44.675244 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2f6f2a23-6091-4103-baf5-3778b9123cc4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:44.682024 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2f6f2a23-6091-4103-baf5-3778b9123cc4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:44.682570 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2f6f2a23-6091-4103-baf5-3778b9123cc4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:44.683343 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2f6f2a23-6091-4103-baf5-3778b9123cc4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:44.683810 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2f6f2a23-6091-4103-baf5-3778b9123cc4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:44.781152 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2f6f2a23-6091-4103-baf5-3778b9123cc4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:44.789811 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2f6f2a23-6091-4103-baf5-3778b9123cc4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:44.791332 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2f6f2a23-6091-4103-baf5-3778b9123cc4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:44.792487 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2f6f2a23-6091-4103-baf5-3778b9123cc4 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1285 microversion: 2.20 time: 0.122779 Jun 17 11:45:44.793227 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 259/520] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:45:44 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1285 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:45:44.810015 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-3309b66e-6720-4dac-8749-b282cf1fb31c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Flavor limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 11:45:44.810542 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-3309b66e-6720-4dac-8749-b282cf1fb31c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Image limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 11:45:44.810887 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-3309b66e-6720-4dac-8749-b282cf1fb31c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Flavor pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 11:45:44.811288 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-3309b66e-6720-4dac-8749-b282cf1fb31c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Image pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 11:45:44.811772 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-3309b66e-6720-4dac-8749-b282cf1fb31c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 11:45:44.822655 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3309b66e-6720-4dac-8749-b282cf1fb31c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:44.823096 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3309b66e-6720-4dac-8749-b282cf1fb31c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:44.823926 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3309b66e-6720-4dac-8749-b282cf1fb31c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:44.824383 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3309b66e-6720-4dac-8749-b282cf1fb31c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:44.842017 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-3309b66e-6720-4dac-8749-b282cf1fb31c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Getting quotas for project f6832cdc6d4e43eb9eae4585ef36e611. Resources: {'instances', 'ram', 'cores'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 11:45:44.846494 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-3309b66e-6720-4dac-8749-b282cf1fb31c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Getting quotas for user 948450e8b1fb4a85a40fbc0a0dacfdde and project f6832cdc6d4e43eb9eae4585ef36e611. Resources: {'instances', 'ram', 'cores'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 11:45:44.914234 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-3309b66e-6720-4dac-8749-b282cf1fb31c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Going to run 1 instances... {{(pid=124844) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 11:45:44.916386 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-3309b66e-6720-4dac-8749-b282cf1fb31c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='364805d2-1454-44d7-baf0-341865174340',volume_size=None,volume_type=None)] {{(pid=124844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 11:45:44.927812 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-88c03b94-b600-43c8-81af-3d6a422fcb2b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:44.928422 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-88c03b94-b600-43c8-81af-3d6a422fcb2b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:44.934523 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-88c03b94-b600-43c8-81af-3d6a422fcb2b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:44.934967 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-88c03b94-b600-43c8-81af-3d6a422fcb2b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:44.935755 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-88c03b94-b600-43c8-81af-3d6a422fcb2b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:44.936186 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-88c03b94-b600-43c8-81af-3d6a422fcb2b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:45.068837 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-88c03b94-b600-43c8-81af-3d6a422fcb2b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:45.076890 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-88c03b94-b600-43c8-81af-3d6a422fcb2b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1357 microversion: 2.1 time: 0.152786 Jun 17 11:45:45.077582 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 260/521] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:44 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:45:45.452108 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-3309b66e-6720-4dac-8749-b282cf1fb31c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.391997 Jun 17 11:45:45.452885 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 262/522] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 17 11:45:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 1394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 11:45:45.464545 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f0246a6c-c738-40e1-93c0-97650cc5db9e tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:45.465240 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f0246a6c-c738-40e1-93c0-97650cc5db9e tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:45.550408 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f0246a6c-c738-40e1-93c0-97650cc5db9e tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:45.557795 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f0246a6c-c738-40e1-93c0-97650cc5db9e tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1087 microversion: 2.1 time: 0.097275 Jun 17 11:45:45.558390 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 261/523] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:45 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1087 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:45.575751 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-af2e07d4-07bc-4fa4-b60f-173eb57ebe17 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:45.589622 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-af2e07d4-07bc-4fa4-b60f-173eb57ebe17 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:45.589622 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-af2e07d4-07bc-4fa4-b60f-173eb57ebe17 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:45.589622 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-af2e07d4-07bc-4fa4-b60f-173eb57ebe17 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:45.589622 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-af2e07d4-07bc-4fa4-b60f-173eb57ebe17 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:45.590501 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-af2e07d4-07bc-4fa4-b60f-173eb57ebe17 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:45.810723 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-df2033f4-63f7-4564-bbc7-d7f43629491f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:45.811548 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-df2033f4-63f7-4564-bbc7-d7f43629491f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:45.819660 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-df2033f4-63f7-4564-bbc7-d7f43629491f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:45.820118 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-df2033f4-63f7-4564-bbc7-d7f43629491f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:45.821191 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-df2033f4-63f7-4564-bbc7-d7f43629491f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:45.821371 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-df2033f4-63f7-4564-bbc7-d7f43629491f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:45.917688 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-af2e07d4-07bc-4fa4-b60f-173eb57ebe17 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:45.927792 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-af2e07d4-07bc-4fa4-b60f-173eb57ebe17 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b" status: 200 len: 1365 microversion: 2.1 time: 0.355611 Jun 17 11:45:45.938714 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-df2033f4-63f7-4564-bbc7-d7f43629491f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:45.948411 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 263/524] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:45 2022] GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b => generated 1365 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:45.948720 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-df2033f4-63f7-4564-bbc7-d7f43629491f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:45.949346 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-df2033f4-63f7-4564-bbc7-d7f43629491f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:45.950503 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-df2033f4-63f7-4564-bbc7-d7f43629491f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1277 microversion: 2.20 time: 0.143742 Jun 17 11:45:45.951419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 262/525] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:45:45 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1277 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:45:46.094246 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5bfcfcbb-4839-41a4-bb89-c6edfc1920ba tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:46.095698 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-5bfcfcbb-4839-41a4-bb89-c6edfc1920ba tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:46.099074 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:45:46.105283 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5bfcfcbb-4839-41a4-bb89-c6edfc1920ba tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:46.116463 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5bfcfcbb-4839-41a4-bb89-c6edfc1920ba tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:46.116463 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5bfcfcbb-4839-41a4-bb89-c6edfc1920ba tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:46.116463 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5bfcfcbb-4839-41a4-bb89-c6edfc1920ba tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:46.399327 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5bfcfcbb-4839-41a4-bb89-c6edfc1920ba tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:46.408299 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5bfcfcbb-4839-41a4-bb89-c6edfc1920ba tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1357 microversion: 2.1 time: 0.317902 Jun 17 11:45:46.409002 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 264/526] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:46 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1357 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:45:46.575043 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c13be65b-9f6f-402f-a6ef-8511684f1167 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:46.575710 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c13be65b-9f6f-402f-a6ef-8511684f1167 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:46.660500 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c13be65b-9f6f-402f-a6ef-8511684f1167 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:46.669691 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c13be65b-9f6f-402f-a6ef-8511684f1167 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1087 microversion: 2.1 time: 0.098627 Jun 17 11:45:46.683754 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 263/527] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:46 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1087 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:46.946224 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-357906a3-950f-4d06-ad28-6a44e9a6c3a9 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:46.946813 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-357906a3-950f-4d06-ad28-6a44e9a6c3a9 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:46.954114 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-357906a3-950f-4d06-ad28-6a44e9a6c3a9 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:46.954654 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-357906a3-950f-4d06-ad28-6a44e9a6c3a9 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:46.955470 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-357906a3-950f-4d06-ad28-6a44e9a6c3a9 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:46.955932 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-357906a3-950f-4d06-ad28-6a44e9a6c3a9 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:46.976089 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-da724894-957a-4ee2-b66f-77dc83e41d63 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:46.976956 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-da724894-957a-4ee2-b66f-77dc83e41d63 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:46.985644 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-da724894-957a-4ee2-b66f-77dc83e41d63 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:46.986598 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-da724894-957a-4ee2-b66f-77dc83e41d63 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:46.987693 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-da724894-957a-4ee2-b66f-77dc83e41d63 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:46.988138 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-da724894-957a-4ee2-b66f-77dc83e41d63 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:47.337449 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-da724894-957a-4ee2-b66f-77dc83e41d63 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:47.346529 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-da724894-957a-4ee2-b66f-77dc83e41d63 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:47.348185 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-da724894-957a-4ee2-b66f-77dc83e41d63 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:47.349288 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-da724894-957a-4ee2-b66f-77dc83e41d63 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1341 microversion: 2.20 time: 0.377798 Jun 17 11:45:47.349849 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 264/528] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:45:46 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1341 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:45:47.382101 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-357906a3-950f-4d06-ad28-6a44e9a6c3a9 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:47.389759 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-357906a3-950f-4d06-ad28-6a44e9a6c3a9 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b" status: 200 len: 1365 microversion: 2.1 time: 0.447448 Jun 17 11:45:47.390332 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 265/529] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:46 2022] GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b => generated 1365 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:47.426228 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a516c589-4967-4ad2-9878-cc60616ba7a3 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:47.426840 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a516c589-4967-4ad2-9878-cc60616ba7a3 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:47.433085 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a516c589-4967-4ad2-9878-cc60616ba7a3 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:47.433655 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a516c589-4967-4ad2-9878-cc60616ba7a3 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:47.434431 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a516c589-4967-4ad2-9878-cc60616ba7a3 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:47.434900 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a516c589-4967-4ad2-9878-cc60616ba7a3 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:47.567204 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a516c589-4967-4ad2-9878-cc60616ba7a3 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:47.575265 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a516c589-4967-4ad2-9878-cc60616ba7a3 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1357 microversion: 2.1 time: 0.153733 Jun 17 11:45:47.575861 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 265/530] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:47 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:47.691168 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-7010f28c-5168-4e5b-8031-4afe0db42cc8 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:47.700248 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7010f28c-5168-4e5b-8031-4afe0db42cc8 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:47.700248 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7010f28c-5168-4e5b-8031-4afe0db42cc8 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:47.700248 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7010f28c-5168-4e5b-8031-4afe0db42cc8 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:47.700248 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7010f28c-5168-4e5b-8031-4afe0db42cc8 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:47.700647 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7010f28c-5168-4e5b-8031-4afe0db42cc8 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:47.777669 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7010f28c-5168-4e5b-8031-4afe0db42cc8 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:47.790514 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-7010f28c-5168-4e5b-8031-4afe0db42cc8 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1137 microversion: 2.1 time: 0.104204 Jun 17 11:45:47.791101 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 266/531] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:47 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1137 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:48.368982 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-fbaeaa56-e14f-491c-9a77-bd99863772bc tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:48.369596 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-fbaeaa56-e14f-491c-9a77-bd99863772bc tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:48.377854 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fbaeaa56-e14f-491c-9a77-bd99863772bc tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:48.378462 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fbaeaa56-e14f-491c-9a77-bd99863772bc tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:48.379490 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fbaeaa56-e14f-491c-9a77-bd99863772bc tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:48.380037 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fbaeaa56-e14f-491c-9a77-bd99863772bc tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:48.409347 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6ca1da9e-d4a8-42d3-a4b3-dfd93809bfd0 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:48.410460 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-6ca1da9e-d4a8-42d3-a4b3-dfd93809bfd0 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:48.419424 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6ca1da9e-d4a8-42d3-a4b3-dfd93809bfd0 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:48.419874 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6ca1da9e-d4a8-42d3-a4b3-dfd93809bfd0 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:48.420717 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6ca1da9e-d4a8-42d3-a4b3-dfd93809bfd0 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:48.421158 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6ca1da9e-d4a8-42d3-a4b3-dfd93809bfd0 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:48.452923 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-fbaeaa56-e14f-491c-9a77-bd99863772bc tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:48.461808 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-fbaeaa56-e14f-491c-9a77-bd99863772bc tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:48.463347 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-fbaeaa56-e14f-491c-9a77-bd99863772bc tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:48.464552 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-fbaeaa56-e14f-491c-9a77-bd99863772bc tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1351 microversion: 2.20 time: 0.099887 Jun 17 11:45:48.465126 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 266/532] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:45:48 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1351 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:45:48.568952 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-6ca1da9e-d4a8-42d3-a4b3-dfd93809bfd0 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:48.576839 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-6ca1da9e-d4a8-42d3-a4b3-dfd93809bfd0 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b" status: 200 len: 1365 microversion: 2.1 time: 0.173901 Jun 17 11:45:48.577437 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 267/533] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:48 2022] GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:48.592760 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-1abd7c45-0fb1-4d39-aa5a-bd074299951f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:48.593372 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-1abd7c45-0fb1-4d39-aa5a-bd074299951f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:48.600961 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1abd7c45-0fb1-4d39-aa5a-bd074299951f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:48.601399 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1abd7c45-0fb1-4d39-aa5a-bd074299951f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:48.602169 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1abd7c45-0fb1-4d39-aa5a-bd074299951f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:48.602594 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1abd7c45-0fb1-4d39-aa5a-bd074299951f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:48.811250 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-de36eafb-9c3b-4b06-a4ba-98c583820ea8 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:48.812842 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-de36eafb-9c3b-4b06-a4ba-98c583820ea8 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:48.821718 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-de36eafb-9c3b-4b06-a4ba-98c583820ea8 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:48.823516 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-de36eafb-9c3b-4b06-a4ba-98c583820ea8 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:48.823516 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-de36eafb-9c3b-4b06-a4ba-98c583820ea8 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:48.823811 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-de36eafb-9c3b-4b06-a4ba-98c583820ea8 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:48.849418 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-1abd7c45-0fb1-4d39-aa5a-bd074299951f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:48.858813 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-1abd7c45-0fb1-4d39-aa5a-bd074299951f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1357 microversion: 2.1 time: 0.269861 Jun 17 11:45:48.859939 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 267/534] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:48 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1357 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:48.902446 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-de36eafb-9c3b-4b06-a4ba-98c583820ea8 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:48.911846 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-de36eafb-9c3b-4b06-a4ba-98c583820ea8 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1137 microversion: 2.1 time: 0.108015 Jun 17 11:45:48.919803 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 268/535] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:48 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1137 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:45:49.486507 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-03edf933-d2b5-473b-8986-61f5270f2214 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:49.487976 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-03edf933-d2b5-473b-8986-61f5270f2214 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:49.496480 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:DELETE=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:45:49.504311 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-03edf933-d2b5-473b-8986-61f5270f2214 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:49.505040 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-03edf933-d2b5-473b-8986-61f5270f2214 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:49.506007 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-03edf933-d2b5-473b-8986-61f5270f2214 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:49.506635 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-03edf933-d2b5-473b-8986-61f5270f2214 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:49.599696 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-fb81276c-473f-4283-a9e3-819b7523faa5 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:49.600367 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-03edf933-d2b5-473b-8986-61f5270f2214 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:49.600844 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-fb81276c-473f-4283-a9e3-819b7523faa5 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:49.610133 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-03edf933-d2b5-473b-8986-61f5270f2214 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:49.611983 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-03edf933-d2b5-473b-8986-61f5270f2214 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:49.612612 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fb81276c-473f-4283-a9e3-819b7523faa5 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:49.613157 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-03edf933-d2b5-473b-8986-61f5270f2214 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1339 microversion: 2.20 time: 0.133766 Jun 17 11:45:49.613449 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fb81276c-473f-4283-a9e3-819b7523faa5 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:49.614200 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 268/536] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:45:49 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1339 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:45:49.616209 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fb81276c-473f-4283-a9e3-819b7523faa5 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:49.616661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fb81276c-473f-4283-a9e3-819b7523faa5 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:49.878020 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-fb81276c-473f-4283-a9e3-819b7523faa5 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:49.881109 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b846a822-f657-49c8-9be3-0ed28ba1ad67 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:49.882669 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b846a822-f657-49c8-9be3-0ed28ba1ad67 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:49.888627 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-fb81276c-473f-4283-a9e3-819b7523faa5 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b" status: 200 len: 1365 microversion: 2.1 time: 0.297158 Jun 17 11:45:49.902506 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 269/537] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:49 2022] GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b => generated 1365 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:45:49.907208 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b846a822-f657-49c8-9be3-0ed28ba1ad67 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:49.908285 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b846a822-f657-49c8-9be3-0ed28ba1ad67 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:49.910545 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b846a822-f657-49c8-9be3-0ed28ba1ad67 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:49.912308 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b846a822-f657-49c8-9be3-0ed28ba1ad67 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:49.917437 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=4 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:45:49.931522 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a82e6637-0626-4f55-ad80-9fd623962fb9 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:49.934482 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a82e6637-0626-4f55-ad80-9fd623962fb9 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:49.948126 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a82e6637-0626-4f55-ad80-9fd623962fb9 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:49.949254 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a82e6637-0626-4f55-ad80-9fd623962fb9 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:49.950507 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a82e6637-0626-4f55-ad80-9fd623962fb9 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:49.951417 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a82e6637-0626-4f55-ad80-9fd623962fb9 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:50.064506 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a82e6637-0626-4f55-ad80-9fd623962fb9 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:50.079341 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a82e6637-0626-4f55-ad80-9fd623962fb9 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1185 microversion: 2.1 time: 0.152407 Jun 17 11:45:50.080831 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 270/538] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:49 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1185 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:45:50.313026 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b846a822-f657-49c8-9be3-0ed28ba1ad67 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:50.321799 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b846a822-f657-49c8-9be3-0ed28ba1ad67 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1357 microversion: 2.1 time: 0.449249 Jun 17 11:45:50.334324 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 269/539] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:49 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1357 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:50.650161 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2fde9d03-8c4c-4b28-977f-65736010843b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:50.650161 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-2fde9d03-8c4c-4b28-977f-65736010843b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:50.654603 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2fde9d03-8c4c-4b28-977f-65736010843b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:50.655421 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2fde9d03-8c4c-4b28-977f-65736010843b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:50.657748 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2fde9d03-8c4c-4b28-977f-65736010843b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:50.658447 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2fde9d03-8c4c-4b28-977f-65736010843b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:50.675590 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=100 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:45:50.893495 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2fde9d03-8c4c-4b28-977f-65736010843b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:50.923727 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-747dbf4d-f5c5-46d1-9afa-552e98d56235 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:50.924860 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-747dbf4d-f5c5-46d1-9afa-552e98d56235 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:50.933361 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2fde9d03-8c4c-4b28-977f-65736010843b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:50.943207 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2fde9d03-8c4c-4b28-977f-65736010843b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:50.948007 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2fde9d03-8c4c-4b28-977f-65736010843b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1406 microversion: 2.20 time: 0.303015 Jun 17 11:45:50.965490 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 271/540] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:45:50 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1406 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:45:50.975571 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-747dbf4d-f5c5-46d1-9afa-552e98d56235 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:50.976689 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-747dbf4d-f5c5-46d1-9afa-552e98d56235 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:50.978448 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-747dbf4d-f5c5-46d1-9afa-552e98d56235 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:50.983796 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-747dbf4d-f5c5-46d1-9afa-552e98d56235 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:51.109128 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2433cdcd-3347-4830-afa9-3de16047c5ce tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:51.110083 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-2433cdcd-3347-4830-afa9-3de16047c5ce tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:51.121883 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2433cdcd-3347-4830-afa9-3de16047c5ce tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:51.132835 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2433cdcd-3347-4830-afa9-3de16047c5ce tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:51.139488 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2433cdcd-3347-4830-afa9-3de16047c5ce tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:51.142161 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2433cdcd-3347-4830-afa9-3de16047c5ce tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:51.293012 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2433cdcd-3347-4830-afa9-3de16047c5ce tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:51.310881 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2433cdcd-3347-4830-afa9-3de16047c5ce tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1203 microversion: 2.1 time: 0.209229 Jun 17 11:45:51.312085 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 272/541] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:51 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1203 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:45:51.343287 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-42c058c0-4388-4172-ae6f-7c7e87ef20b1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:51.345483 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-42c058c0-4388-4172-ae6f-7c7e87ef20b1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:51.357290 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-42c058c0-4388-4172-ae6f-7c7e87ef20b1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:51.358247 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-42c058c0-4388-4172-ae6f-7c7e87ef20b1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:51.360612 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-42c058c0-4388-4172-ae6f-7c7e87ef20b1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:51.361503 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-42c058c0-4388-4172-ae6f-7c7e87ef20b1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:51.389379 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-747dbf4d-f5c5-46d1-9afa-552e98d56235 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:51.403858 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-747dbf4d-f5c5-46d1-9afa-552e98d56235 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b" status: 200 len: 1365 microversion: 2.1 time: 0.498173 Jun 17 11:45:51.418516 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 270/542] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:50 2022] GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b => generated 1365 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:51.427706 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6c583306-fa49-4e05-b997-b0719392fb63 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:51.428685 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-6c583306-fa49-4e05-b997-b0719392fb63 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:51.452809 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6c583306-fa49-4e05-b997-b0719392fb63 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:51.452809 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6c583306-fa49-4e05-b997-b0719392fb63 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:51.452809 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6c583306-fa49-4e05-b997-b0719392fb63 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:51.454367 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6c583306-fa49-4e05-b997-b0719392fb63 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:51.522042 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-42c058c0-4388-4172-ae6f-7c7e87ef20b1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lazy-loading 'services' on Instance uuid 9a27dd59-4638-430d-a484-d38ed6fcf923 {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:45:51.792096 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6c583306-fa49-4e05-b997-b0719392fb63 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:51.807852 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-6c583306-fa49-4e05-b997-b0719392fb63 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1357 microversion: 2.1 time: 0.383888 Jun 17 11:45:51.807852 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 271/543] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:51 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1357 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:51.818650 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-db1ed2ec-53b0-4b77-adb5-152934f75ba3 req-5c3e5ef4-8d78-42d4-a992-f1c91243b64e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4eb9c8c-b733-475e-b69e-279e9295ac4d", "tag": "f00e28a8-041d-4c99-8685-2e89673ad6b8"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:45:51.837682 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-db1ed2ec-53b0-4b77-adb5-152934f75ba3 req-5c3e5ef4-8d78-42d4-a992-f1c91243b64e service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:51.841537 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-db1ed2ec-53b0-4b77-adb5-152934f75ba3 req-5c3e5ef4-8d78-42d4-a992-f1c91243b64e service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:51.854847 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-db1ed2ec-53b0-4b77-adb5-152934f75ba3 req-5c3e5ef4-8d78-42d4-a992-f1c91243b64e service nova] Creating event network-changed:f00e28a8-041d-4c99-8685-2e89673ad6b8 for instance f4eb9c8c-b733-475e-b69e-279e9295ac4d on hv-cinder-83716 Jun 17 11:45:51.861925 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-db1ed2ec-53b0-4b77-adb5-152934f75ba3 req-5c3e5ef4-8d78-42d4-a992-f1c91243b64e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051526 Jun 17 11:45:51.867009 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 272/544] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:45:51.896635 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-42c058c0-4388-4172-ae6f-7c7e87ef20b1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923/os-volume_attachments/67653af2-2434-4859-b288-fce97f70ad1c" status: 202 len: 0 microversion: 2.1 time: 0.580705 Jun 17 11:45:51.903478 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 273/545] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Jun 17 11:45:51 2022] DELETE /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923/os-volume_attachments/67653af2-2434-4859-b288-fce97f70ad1c => generated 0 bytes in 591 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 11:45:51.927667 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9e8530ba-854d-4002-ab4c-33c6470a2dc4 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:51.939199 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9e8530ba-854d-4002-ab4c-33c6470a2dc4 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:51.945385 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9e8530ba-854d-4002-ab4c-33c6470a2dc4 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:51.946363 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9e8530ba-854d-4002-ab4c-33c6470a2dc4 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:51.947983 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9e8530ba-854d-4002-ab4c-33c6470a2dc4 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:51.949279 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9e8530ba-854d-4002-ab4c-33c6470a2dc4 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:51.960667 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=100 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:45:51.991139 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5ef021ab-c4b5-444e-95c7-3ebb0027f92c tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:51.992751 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-5ef021ab-c4b5-444e-95c7-3ebb0027f92c tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:52.005586 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5ef021ab-c4b5-444e-95c7-3ebb0027f92c tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:52.006683 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5ef021ab-c4b5-444e-95c7-3ebb0027f92c tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:52.009009 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5ef021ab-c4b5-444e-95c7-3ebb0027f92c tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:52.009976 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5ef021ab-c4b5-444e-95c7-3ebb0027f92c tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:52.041223 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9e8530ba-854d-4002-ab4c-33c6470a2dc4 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129155 Jun 17 11:45:52.048134 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 273/546] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 17 11:45:51 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:45:52.335471 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0c9453c8-db83-4a6c-8476-bf3616e5ba0c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:52.336277 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0c9453c8-db83-4a6c-8476-bf3616e5ba0c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:52.349847 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0c9453c8-db83-4a6c-8476-bf3616e5ba0c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:52.349847 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0c9453c8-db83-4a6c-8476-bf3616e5ba0c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:52.350226 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0c9453c8-db83-4a6c-8476-bf3616e5ba0c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:52.350581 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0c9453c8-db83-4a6c-8476-bf3616e5ba0c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:52.377701 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5ef021ab-c4b5-444e-95c7-3ebb0027f92c tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:52.402453 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5ef021ab-c4b5-444e-95c7-3ebb0027f92c tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:52.404763 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5ef021ab-c4b5-444e-95c7-3ebb0027f92c tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:52.406235 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5ef021ab-c4b5-444e-95c7-3ebb0027f92c tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1406 microversion: 2.20 time: 0.425683 Jun 17 11:45:52.408356 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 274/547] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:45:51 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1406 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:45:52.433749 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a7ffd221-7c9e-490f-90ca-339e0a25f81d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:52.434988 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a7ffd221-7c9e-490f-90ca-339e0a25f81d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:52.444039 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a7ffd221-7c9e-490f-90ca-339e0a25f81d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:52.445157 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a7ffd221-7c9e-490f-90ca-339e0a25f81d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:52.446390 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a7ffd221-7c9e-490f-90ca-339e0a25f81d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:52.446845 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a7ffd221-7c9e-490f-90ca-339e0a25f81d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:52.656289 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0c9453c8-db83-4a6c-8476-bf3616e5ba0c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:52.666015 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0c9453c8-db83-4a6c-8476-bf3616e5ba0c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1270 microversion: 2.1 time: 0.335254 Jun 17 11:45:52.676962 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 274/548] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:52 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1270 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:45:52.832492 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-463f1328-29b3-4849-a5d3-582601f050ec tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:52.833326 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-463f1328-29b3-4849-a5d3-582601f050ec tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:52.840801 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-463f1328-29b3-4849-a5d3-582601f050ec tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:52.841352 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-463f1328-29b3-4849-a5d3-582601f050ec tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:52.842164 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-463f1328-29b3-4849-a5d3-582601f050ec tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:52.843041 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-463f1328-29b3-4849-a5d3-582601f050ec tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:52.979382 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a7ffd221-7c9e-490f-90ca-339e0a25f81d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:52.987948 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a7ffd221-7c9e-490f-90ca-339e0a25f81d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b" status: 200 len: 1365 microversion: 2.1 time: 0.561758 Jun 17 11:45:52.988535 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 275/549] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:52 2022] GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b => generated 1365 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:45:53.056630 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-9bf247bc-9114-46cb-9c72-fbf2d5f21d39 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:53.057927 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-9bf247bc-9114-46cb-9c72-fbf2d5f21d39 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:53.065266 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9bf247bc-9114-46cb-9c72-fbf2d5f21d39 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:53.065771 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9bf247bc-9114-46cb-9c72-fbf2d5f21d39 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:53.066561 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9bf247bc-9114-46cb-9c72-fbf2d5f21d39 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:53.067075 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9bf247bc-9114-46cb-9c72-fbf2d5f21d39 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:53.104401 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-9bf247bc-9114-46cb-9c72-fbf2d5f21d39 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045341 Jun 17 11:45:53.104401 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 276/550] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 17 11:45:53 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:45:53.184863 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-463f1328-29b3-4849-a5d3-582601f050ec tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:53.192778 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-463f1328-29b3-4849-a5d3-582601f050ec tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1357 microversion: 2.1 time: 0.365440 Jun 17 11:45:53.195317 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 275/551] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:52 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1357 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:45:53.429896 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-5d5124a8-f6f0-4aa8-b65e-664f2e6c61fc req-93df0e4b-68f6-4771-9249-158eb620cea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b705046-ed66-4a09-9354-18ee01d1676b", "name": "network-vif-plugged", "status": "completed", "tag": "59a1be8f-e417-465c-8536-98f4405514f7"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:45:53.439631 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0f57cccc-2f19-4db4-a9cb-28ef0e794725 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:53.440613 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0f57cccc-2f19-4db4-a9cb-28ef0e794725 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:53.454298 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-5d5124a8-f6f0-4aa8-b65e-664f2e6c61fc req-93df0e4b-68f6-4771-9249-158eb620cea3 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:53.454883 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-5d5124a8-f6f0-4aa8-b65e-664f2e6c61fc req-93df0e4b-68f6-4771-9249-158eb620cea3 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:53.455509 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0f57cccc-2f19-4db4-a9cb-28ef0e794725 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:53.456203 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0f57cccc-2f19-4db4-a9cb-28ef0e794725 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:53.457089 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0f57cccc-2f19-4db4-a9cb-28ef0e794725 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:53.457742 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0f57cccc-2f19-4db4-a9cb-28ef0e794725 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:53.482054 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-5d5124a8-f6f0-4aa8-b65e-664f2e6c61fc req-93df0e4b-68f6-4771-9249-158eb620cea3 service nova] Creating event network-vif-plugged:59a1be8f-e417-465c-8536-98f4405514f7 for instance 4b705046-ed66-4a09-9354-18ee01d1676b on hv-cinder-83716 Jun 17 11:45:53.492298 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-5d5124a8-f6f0-4aa8-b65e-664f2e6c61fc req-93df0e4b-68f6-4771-9249-158eb620cea3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066145 Jun 17 11:45:53.493208 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 277/552] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:45:53.697822 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2682ea87-5a5c-4c9b-b77b-01c3e4d57bcb tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:53.705097 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-2682ea87-5a5c-4c9b-b77b-01c3e4d57bcb tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:53.709017 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0f57cccc-2f19-4db4-a9cb-28ef0e794725 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:53.723883 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2682ea87-5a5c-4c9b-b77b-01c3e4d57bcb tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:53.724196 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0f57cccc-2f19-4db4-a9cb-28ef0e794725 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:53.725130 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2682ea87-5a5c-4c9b-b77b-01c3e4d57bcb tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:53.726240 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2682ea87-5a5c-4c9b-b77b-01c3e4d57bcb tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:53.726589 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0f57cccc-2f19-4db4-a9cb-28ef0e794725 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:53.727219 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2682ea87-5a5c-4c9b-b77b-01c3e4d57bcb tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:53.727840 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0f57cccc-2f19-4db4-a9cb-28ef0e794725 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1406 microversion: 2.20 time: 0.292434 Jun 17 11:45:53.730928 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 276/553] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:45:53 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1406 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:45:53.956484 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2682ea87-5a5c-4c9b-b77b-01c3e4d57bcb tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:53.974558 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2682ea87-5a5c-4c9b-b77b-01c3e4d57bcb tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1258 microversion: 2.1 time: 0.292421 Jun 17 11:45:53.992809 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 278/554] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:53 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1258 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:54.006552 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9cc09c71-a641-4f03-8af0-c1b7c48609a8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:54.007175 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9cc09c71-a641-4f03-8af0-c1b7c48609a8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:54.014268 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9cc09c71-a641-4f03-8af0-c1b7c48609a8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:54.014824 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9cc09c71-a641-4f03-8af0-c1b7c48609a8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:54.016427 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9cc09c71-a641-4f03-8af0-c1b7c48609a8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:54.017222 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9cc09c71-a641-4f03-8af0-c1b7c48609a8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:54.108645 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c8861155-b83c-4629-95ee-a12d65d91830 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:54.110692 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c8861155-b83c-4629-95ee-a12d65d91830 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:54.118029 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c8861155-b83c-4629-95ee-a12d65d91830 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:54.118722 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c8861155-b83c-4629-95ee-a12d65d91830 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:54.119267 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c8861155-b83c-4629-95ee-a12d65d91830 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:54.119734 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c8861155-b83c-4629-95ee-a12d65d91830 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:54.170022 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c8861155-b83c-4629-95ee-a12d65d91830 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064144 Jun 17 11:45:54.173606 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 279/555] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 17 11:45:54 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 11:45:54.192672 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-217a6618-1f33-42ae-94a6-aa97d088c527 req-a36596f7-25d9-41cd-9720-0c1d5169a27d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef2e4aca-bc09-41dd-9f63-3a8649cf871c", "tag": "0b44766a-48d1-49bc-a348-b25e0252287f"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:45:54.213381 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-217a6618-1f33-42ae-94a6-aa97d088c527 req-a36596f7-25d9-41cd-9720-0c1d5169a27d service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:54.215728 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-217a6618-1f33-42ae-94a6-aa97d088c527 req-a36596f7-25d9-41cd-9720-0c1d5169a27d service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:54.238114 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9cc09c71-a641-4f03-8af0-c1b7c48609a8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:54.249829 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9cc09c71-a641-4f03-8af0-c1b7c48609a8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b" status: 200 len: 1365 microversion: 2.1 time: 0.247339 Jun 17 11:45:54.262012 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-217a6618-1f33-42ae-94a6-aa97d088c527 req-a36596f7-25d9-41cd-9720-0c1d5169a27d service nova] Creating event network-changed:0b44766a-48d1-49bc-a348-b25e0252287f for instance ef2e4aca-bc09-41dd-9f63-3a8649cf871c on hv-cinder-83716 Jun 17 11:45:54.263096 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 277/556] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:54 2022] GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b => generated 1365 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:45:54.269881 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-fba8a362-926b-4874-bbe3-97206b1f9b16 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:54.270525 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-fba8a362-926b-4874-bbe3-97206b1f9b16 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:54.272583 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-217a6618-1f33-42ae-94a6-aa97d088c527 req-a36596f7-25d9-41cd-9720-0c1d5169a27d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088463 Jun 17 11:45:54.275029 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 280/557] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:45:54.292267 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fba8a362-926b-4874-bbe3-97206b1f9b16 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:54.296612 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fba8a362-926b-4874-bbe3-97206b1f9b16 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:54.296612 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fba8a362-926b-4874-bbe3-97206b1f9b16 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:54.297940 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fba8a362-926b-4874-bbe3-97206b1f9b16 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:54.316486 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8e3ac110-bcb9-4ebc-85f3-ecb16efce531 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:54.319387 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-8e3ac110-bcb9-4ebc-85f3-ecb16efce531 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:54.332959 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8e3ac110-bcb9-4ebc-85f3-ecb16efce531 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:54.333715 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8e3ac110-bcb9-4ebc-85f3-ecb16efce531 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:54.335068 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8e3ac110-bcb9-4ebc-85f3-ecb16efce531 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:54.335835 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8e3ac110-bcb9-4ebc-85f3-ecb16efce531 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:54.389188 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-8e3ac110-bcb9-4ebc-85f3-ecb16efce531 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Going to try to terminate instance {{(pid=124844) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 11:45:54.499122 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-fba8a362-926b-4874-bbe3-97206b1f9b16 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:54.507777 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-fba8a362-926b-4874-bbe3-97206b1f9b16 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1357 microversion: 2.1 time: 0.243407 Jun 17 11:45:54.508458 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 278/558] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:54 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1357 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:54.759861 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-1fccb7db-b8ab-49c8-b43f-189e99ea9529 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:54.760653 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-1fccb7db-b8ab-49c8-b43f-189e99ea9529 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:54.769146 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1fccb7db-b8ab-49c8-b43f-189e99ea9529 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:54.769599 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1fccb7db-b8ab-49c8-b43f-189e99ea9529 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:54.770439 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1fccb7db-b8ab-49c8-b43f-189e99ea9529 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:54.770998 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1fccb7db-b8ab-49c8-b43f-189e99ea9529 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:54.784904 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-8e3ac110-bcb9-4ebc-85f3-ecb16efce531 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 204 len: 0 microversion: 2.1 time: 0.476759 Jun 17 11:45:54.786567 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 281/559] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 17 11:45:54 2022] DELETE /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 11:45:54.802908 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b97a31da-3378-441b-a98c-ad2ee83dd035 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:54.804116 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b97a31da-3378-441b-a98c-ad2ee83dd035 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:54.815709 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b97a31da-3378-441b-a98c-ad2ee83dd035 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:54.817694 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b97a31da-3378-441b-a98c-ad2ee83dd035 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:54.819124 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b97a31da-3378-441b-a98c-ad2ee83dd035 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:54.819968 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b97a31da-3378-441b-a98c-ad2ee83dd035 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:54.847898 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=2 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:45:54.860936 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=6 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:45:55.144653 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-1fccb7db-b8ab-49c8-b43f-189e99ea9529 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:55.155136 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b97a31da-3378-441b-a98c-ad2ee83dd035 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:55.155953 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-1fccb7db-b8ab-49c8-b43f-189e99ea9529 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:55.158126 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-1fccb7db-b8ab-49c8-b43f-189e99ea9529 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:55.159353 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-1fccb7db-b8ab-49c8-b43f-189e99ea9529 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1406 microversion: 2.20 time: 0.407970 Jun 17 11:45:55.161002 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 279/560] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:45:54 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1406 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:45:55.170539 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b97a31da-3378-441b-a98c-ad2ee83dd035 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1688 microversion: 2.1 time: 0.378292 Jun 17 11:45:55.173100 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 282/561] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:54 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1688 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:55.176464 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e7be9a49-6338-4d0d-b382-243a9b403ec2 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:55.177221 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-e7be9a49-6338-4d0d-b382-243a9b403ec2 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:55.184457 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e7be9a49-6338-4d0d-b382-243a9b403ec2 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:55.184909 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e7be9a49-6338-4d0d-b382-243a9b403ec2 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:55.185719 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e7be9a49-6338-4d0d-b382-243a9b403ec2 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:55.186185 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e7be9a49-6338-4d0d-b382-243a9b403ec2 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:55.268718 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f05568ca-a4ea-41f3-a48c-d16f24e85be2 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:55.269246 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f05568ca-a4ea-41f3-a48c-d16f24e85be2 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:55.275951 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f05568ca-a4ea-41f3-a48c-d16f24e85be2 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:55.276408 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f05568ca-a4ea-41f3-a48c-d16f24e85be2 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:55.277271 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f05568ca-a4ea-41f3-a48c-d16f24e85be2 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:55.277726 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f05568ca-a4ea-41f3-a48c-d16f24e85be2 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:55.352767 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-e7be9a49-6338-4d0d-b382-243a9b403ec2 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:55.361271 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-e7be9a49-6338-4d0d-b382-243a9b403ec2 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1258 microversion: 2.1 time: 0.198600 Jun 17 11:45:55.361859 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 280/562] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:55 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1258 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:55.446315 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f05568ca-a4ea-41f3-a48c-d16f24e85be2 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:55.455010 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f05568ca-a4ea-41f3-a48c-d16f24e85be2 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b" status: 200 len: 1365 microversion: 2.1 time: 0.190847 Jun 17 11:45:55.455632 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 283/563] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:55 2022] GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b => generated 1365 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:55.511992 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-0a710a81-8c4c-40bf-9865-a21f9d31860f req-7af1796c-af77-4646-b249-e522b613445f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907", "name": "network-vif-plugged", "status": "completed", "tag": "f866082a-76d6-466b-8c49-7a5068d4d87f"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:45:55.523311 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-0a710a81-8c4c-40bf-9865-a21f9d31860f req-7af1796c-af77-4646-b249-e522b613445f service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:55.523688 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-0a710a81-8c4c-40bf-9865-a21f9d31860f req-7af1796c-af77-4646-b249-e522b613445f service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:55.526324 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-21d1822a-e7c8-4b3c-aef8-2318a788822c tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:55.527040 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-21d1822a-e7c8-4b3c-aef8-2318a788822c tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:55.534224 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-21d1822a-e7c8-4b3c-aef8-2318a788822c tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:55.534488 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-21d1822a-e7c8-4b3c-aef8-2318a788822c tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:55.535232 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-21d1822a-e7c8-4b3c-aef8-2318a788822c tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:55.535698 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-21d1822a-e7c8-4b3c-aef8-2318a788822c tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:55.536407 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-0a710a81-8c4c-40bf-9865-a21f9d31860f req-7af1796c-af77-4646-b249-e522b613445f service nova] Creating event network-vif-plugged:f866082a-76d6-466b-8c49-7a5068d4d87f for instance 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 on hv-cinder-83716 Jun 17 11:45:55.541662 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-0a710a81-8c4c-40bf-9865-a21f9d31860f req-7af1796c-af77-4646-b249-e522b613445f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033298 Jun 17 11:45:55.542280 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 281/564] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:45:55.691898 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-21d1822a-e7c8-4b3c-aef8-2318a788822c tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:55.699643 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-21d1822a-e7c8-4b3c-aef8-2318a788822c tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1357 microversion: 2.1 time: 0.177879 Jun 17 11:45:55.700226 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 284/565] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:55 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:56.179616 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-3850b8eb-b4f2-40c0-b315-56a219fd5c8e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:56.180338 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-3850b8eb-b4f2-40c0-b315-56a219fd5c8e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:56.186902 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3850b8eb-b4f2-40c0-b315-56a219fd5c8e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:56.187339 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3850b8eb-b4f2-40c0-b315-56a219fd5c8e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:56.188828 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d5927497-96d3-4ca2-a364-7b54cb014b60 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:56.189549 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3850b8eb-b4f2-40c0-b315-56a219fd5c8e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:56.189549 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3850b8eb-b4f2-40c0-b315-56a219fd5c8e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:56.189726 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d5927497-96d3-4ca2-a364-7b54cb014b60 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:56.196848 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d5927497-96d3-4ca2-a364-7b54cb014b60 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:56.197289 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d5927497-96d3-4ca2-a364-7b54cb014b60 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:56.198066 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d5927497-96d3-4ca2-a364-7b54cb014b60 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:56.198500 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d5927497-96d3-4ca2-a364-7b54cb014b60 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:56.418547 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d5927497-96d3-4ca2-a364-7b54cb014b60 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:56.429244 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d5927497-96d3-4ca2-a364-7b54cb014b60 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1688 microversion: 2.1 time: 0.244249 Jun 17 11:45:56.430003 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 285/566] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:56 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1688 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:45:56.435161 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-de44e191-f699-4ddd-8c08-b5a5f8af6c94 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:56.435896 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-de44e191-f699-4ddd-8c08-b5a5f8af6c94 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:56.443538 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-de44e191-f699-4ddd-8c08-b5a5f8af6c94 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:56.446491 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-de44e191-f699-4ddd-8c08-b5a5f8af6c94 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:56.446491 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-de44e191-f699-4ddd-8c08-b5a5f8af6c94 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:56.446491 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-de44e191-f699-4ddd-8c08-b5a5f8af6c94 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:56.465206 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-3850b8eb-b4f2-40c0-b315-56a219fd5c8e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:56.475199 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-3850b8eb-b4f2-40c0-b315-56a219fd5c8e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:56.476973 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-3850b8eb-b4f2-40c0-b315-56a219fd5c8e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:56.478142 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-3850b8eb-b4f2-40c0-b315-56a219fd5c8e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1406 microversion: 2.20 time: 0.303433 Jun 17 11:45:56.478715 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 282/567] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:45:56 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1406 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:45:56.490524 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-86d1b54a-5aae-4272-816c-d6f2d28a5878 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:56.491547 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-86d1b54a-5aae-4272-816c-d6f2d28a5878 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:56.503644 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-86d1b54a-5aae-4272-816c-d6f2d28a5878 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:56.504396 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-86d1b54a-5aae-4272-816c-d6f2d28a5878 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:56.506121 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-86d1b54a-5aae-4272-816c-d6f2d28a5878 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:56.506825 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-86d1b54a-5aae-4272-816c-d6f2d28a5878 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:56.668155 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=34 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:45:56.702890 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-de44e191-f699-4ddd-8c08-b5a5f8af6c94 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:56.706416 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:45:56.713680 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-de44e191-f699-4ddd-8c08-b5a5f8af6c94 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1258 microversion: 2.1 time: 0.282602 Jun 17 11:45:56.726870 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 286/568] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:56 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1258 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:56.732583 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-9ca2a2fe-f3ef-4e3f-be2e-5bb3cd086d30 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:56.733549 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-9ca2a2fe-f3ef-4e3f-be2e-5bb3cd086d30 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:56.740447 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-86d1b54a-5aae-4272-816c-d6f2d28a5878 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:56.743252 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9ca2a2fe-f3ef-4e3f-be2e-5bb3cd086d30 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:56.743811 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9ca2a2fe-f3ef-4e3f-be2e-5bb3cd086d30 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:56.744664 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9ca2a2fe-f3ef-4e3f-be2e-5bb3cd086d30 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:56.745102 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9ca2a2fe-f3ef-4e3f-be2e-5bb3cd086d30 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:56.748939 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-86d1b54a-5aae-4272-816c-d6f2d28a5878 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b" status: 200 len: 1365 microversion: 2.1 time: 0.269172 Jun 17 11:45:56.760065 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 283/569] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:56 2022] GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b => generated 1365 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:56.898777 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-9ca2a2fe-f3ef-4e3f-be2e-5bb3cd086d30 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:56.909977 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-9ca2a2fe-f3ef-4e3f-be2e-5bb3cd086d30 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1357 microversion: 2.1 time: 0.181388 Jun 17 11:45:56.910776 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 287/570] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:56 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:57.456554 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-156102b2-db4b-40ce-adec-e2fe4b5c07cc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:57.457237 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-156102b2-db4b-40ce-adec-e2fe4b5c07cc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:57.468218 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-156102b2-db4b-40ce-adec-e2fe4b5c07cc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:57.469027 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-156102b2-db4b-40ce-adec-e2fe4b5c07cc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:57.489693 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-156102b2-db4b-40ce-adec-e2fe4b5c07cc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:57.489693 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-156102b2-db4b-40ce-adec-e2fe4b5c07cc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:57.497032 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-9a3ac4f6-94e9-4186-aa1b-fe1b0edb3962 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:57.497638 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-9a3ac4f6-94e9-4186-aa1b-fe1b0edb3962 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:57.505754 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9a3ac4f6-94e9-4186-aa1b-fe1b0edb3962 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:57.506203 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9a3ac4f6-94e9-4186-aa1b-fe1b0edb3962 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:57.507066 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9a3ac4f6-94e9-4186-aa1b-fe1b0edb3962 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:57.507418 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9a3ac4f6-94e9-4186-aa1b-fe1b0edb3962 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:57.687122 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-156102b2-db4b-40ce-adec-e2fe4b5c07cc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:57.697758 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-156102b2-db4b-40ce-adec-e2fe4b5c07cc tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1688 microversion: 2.1 time: 0.247708 Jun 17 11:45:57.698428 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 284/571] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:57 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1688 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:57.702774 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-9a3ac4f6-94e9-4186-aa1b-fe1b0edb3962 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:57.711537 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-9a3ac4f6-94e9-4186-aa1b-fe1b0edb3962 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:57.712971 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-9a3ac4f6-94e9-4186-aa1b-fe1b0edb3962 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:57.714073 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-9a3ac4f6-94e9-4186-aa1b-fe1b0edb3962 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1406 microversion: 2.20 time: 0.221233 Jun 17 11:45:57.714641 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 288/572] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:45:57 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1406 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:45:57.734085 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c0dd2183-7a90-4b86-9f55-0cf8c05e950b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:57.735333 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c0dd2183-7a90-4b86-9f55-0cf8c05e950b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:57.742516 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c0dd2183-7a90-4b86-9f55-0cf8c05e950b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:57.742959 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c0dd2183-7a90-4b86-9f55-0cf8c05e950b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:57.743760 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c0dd2183-7a90-4b86-9f55-0cf8c05e950b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:57.744193 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c0dd2183-7a90-4b86-9f55-0cf8c05e950b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:57.769749 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-cfb2a5e6-c444-4923-ad86-b06500b979f8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:57.770372 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-cfb2a5e6-c444-4923-ad86-b06500b979f8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:57.776661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cfb2a5e6-c444-4923-ad86-b06500b979f8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:57.777105 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cfb2a5e6-c444-4923-ad86-b06500b979f8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:57.777870 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cfb2a5e6-c444-4923-ad86-b06500b979f8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:57.778301 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cfb2a5e6-c444-4923-ad86-b06500b979f8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:57.951000 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c0dd2183-7a90-4b86-9f55-0cf8c05e950b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:57.961399 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c0dd2183-7a90-4b86-9f55-0cf8c05e950b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1258 microversion: 2.1 time: 0.231078 Jun 17 11:45:57.971588 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 285/573] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:57 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1258 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:57.980101 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-5a6dccc3-1691-401f-a2f6-44b6c6cf759e tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:57.980101 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-5a6dccc3-1691-401f-a2f6-44b6c6cf759e tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:57.980798 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-cfb2a5e6-c444-4923-ad86-b06500b979f8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:57.985503 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5a6dccc3-1691-401f-a2f6-44b6c6cf759e tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:57.986202 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5a6dccc3-1691-401f-a2f6-44b6c6cf759e tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:57.987178 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5a6dccc3-1691-401f-a2f6-44b6c6cf759e tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:57.987760 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5a6dccc3-1691-401f-a2f6-44b6c6cf759e tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:57.990133 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-cfb2a5e6-c444-4923-ad86-b06500b979f8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b" status: 200 len: 1365 microversion: 2.1 time: 0.227137 Jun 17 11:45:57.991050 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 289/574] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:57 2022] GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b => generated 1365 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:45:58.142733 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5a6dccc3-1691-401f-a2f6-44b6c6cf759e tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:58.151637 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-5a6dccc3-1691-401f-a2f6-44b6c6cf759e tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1357 microversion: 2.1 time: 0.187325 Jun 17 11:45:58.152302 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 286/575] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:57 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1357 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:58.576641 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8a78a785-fe6f-4b6f-b951-a54f5c5b0a73 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:58.577552 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-8a78a785-fe6f-4b6f-b951-a54f5c5b0a73 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:58.585796 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8a78a785-fe6f-4b6f-b951-a54f5c5b0a73 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:58.586352 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8a78a785-fe6f-4b6f-b951-a54f5c5b0a73 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:58.587157 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8a78a785-fe6f-4b6f-b951-a54f5c5b0a73 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:58.587720 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8a78a785-fe6f-4b6f-b951-a54f5c5b0a73 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:58.629446 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-8a78a785-fe6f-4b6f-b951-a54f5c5b0a73 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056839 Jun 17 11:45:58.630406 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 290/576] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 17 11:45:58 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 11:45:58.697491 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9db3ccc6-55aa-410e-84f2-2f454295d5ab tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:58.698250 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9db3ccc6-55aa-410e-84f2-2f454295d5ab tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:58.708034 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9db3ccc6-55aa-410e-84f2-2f454295d5ab tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:58.708481 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9db3ccc6-55aa-410e-84f2-2f454295d5ab tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:58.710295 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9db3ccc6-55aa-410e-84f2-2f454295d5ab tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:58.710295 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9db3ccc6-55aa-410e-84f2-2f454295d5ab tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:58.718515 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2f0f45a3-75b3-489d-a26a-18194548996d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:58.719318 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-2f0f45a3-75b3-489d-a26a-18194548996d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:58.726276 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2f0f45a3-75b3-489d-a26a-18194548996d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:58.726865 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2f0f45a3-75b3-489d-a26a-18194548996d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:58.728522 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2f0f45a3-75b3-489d-a26a-18194548996d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:58.729247 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2f0f45a3-75b3-489d-a26a-18194548996d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:58.740724 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9db3ccc6-55aa-410e-84f2-2f454295d5ab tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Going to try to terminate instance {{(pid=124845) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 11:45:58.897451 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2f0f45a3-75b3-489d-a26a-18194548996d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:58.909162 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2f0f45a3-75b3-489d-a26a-18194548996d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1688 microversion: 2.1 time: 0.196789 Jun 17 11:45:58.909945 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 291/577] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:58 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1688 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:58.915178 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-cc3be560-aa2b-4bda-a5ac-45e4c1064ee8 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:58.915898 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-cc3be560-aa2b-4bda-a5ac-45e4c1064ee8 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:58.923477 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cc3be560-aa2b-4bda-a5ac-45e4c1064ee8 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:58.924034 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cc3be560-aa2b-4bda-a5ac-45e4c1064ee8 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:58.924935 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cc3be560-aa2b-4bda-a5ac-45e4c1064ee8 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:58.925629 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cc3be560-aa2b-4bda-a5ac-45e4c1064ee8 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:59.171778 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9db3ccc6-55aa-410e-84f2-2f454295d5ab tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 204 len: 0 microversion: 2.1 time: 0.478735 Jun 17 11:45:59.172779 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 287/578] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 17 11:45:58 2022] DELETE /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 11:45:59.186105 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-ae90664d-b240-4e36-94b6-6e9a5bccfe1a req-4fff622e-2020-49d8-bd2d-30e105d92a7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4eb9c8c-b733-475e-b69e-279e9295ac4d", "name": "network-vif-plugged", "status": "completed", "tag": "f00e28a8-041d-4c99-8685-2e89673ad6b8"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:45:59.202883 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-ae90664d-b240-4e36-94b6-6e9a5bccfe1a req-4fff622e-2020-49d8-bd2d-30e105d92a7b service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:59.204295 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-ae90664d-b240-4e36-94b6-6e9a5bccfe1a req-4fff622e-2020-49d8-bd2d-30e105d92a7b service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:59.229510 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-ae90664d-b240-4e36-94b6-6e9a5bccfe1a req-4fff622e-2020-49d8-bd2d-30e105d92a7b service nova] Creating event network-vif-plugged:f00e28a8-041d-4c99-8685-2e89673ad6b8 for instance f4eb9c8c-b733-475e-b69e-279e9295ac4d on hv-cinder-83716 Jun 17 11:45:59.238972 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-ae90664d-b240-4e36-94b6-6e9a5bccfe1a req-4fff622e-2020-49d8-bd2d-30e105d92a7b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063823 Jun 17 11:45:59.240223 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 288/579] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:45:59.248922 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-7ebb88fe-81ec-48d3-b8b2-5d5da64b3fe5 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:59.251793 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-7ebb88fe-81ec-48d3-b8b2-5d5da64b3fe5 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:59.254930 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-cc3be560-aa2b-4bda-a5ac-45e4c1064ee8 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:59.276915 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7ebb88fe-81ec-48d3-b8b2-5d5da64b3fe5 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:59.276915 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7ebb88fe-81ec-48d3-b8b2-5d5da64b3fe5 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:59.276915 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7ebb88fe-81ec-48d3-b8b2-5d5da64b3fe5 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:59.276915 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7ebb88fe-81ec-48d3-b8b2-5d5da64b3fe5 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:59.277741 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-cc3be560-aa2b-4bda-a5ac-45e4c1064ee8 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:59.277741 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-cc3be560-aa2b-4bda-a5ac-45e4c1064ee8 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:59.277741 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-cc3be560-aa2b-4bda-a5ac-45e4c1064ee8 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1406 microversion: 2.20 time: 0.358266 Jun 17 11:45:59.278227 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 292/580] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:45:58 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1406 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:45:59.278227 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5dcd7c31-08de-4295-85ef-607019f626f8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:59.278227 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-5dcd7c31-08de-4295-85ef-607019f626f8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:59.291964 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5dcd7c31-08de-4295-85ef-607019f626f8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:59.292717 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5dcd7c31-08de-4295-85ef-607019f626f8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:59.294034 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5dcd7c31-08de-4295-85ef-607019f626f8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:59.294248 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:45:59.295057 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5dcd7c31-08de-4295-85ef-607019f626f8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:59.561087 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-7ebb88fe-81ec-48d3-b8b2-5d5da64b3fe5 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:59.569862 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5dcd7c31-08de-4295-85ef-607019f626f8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:59.578842 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-7ebb88fe-81ec-48d3-b8b2-5d5da64b3fe5 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1258 microversion: 2.1 time: 0.328074 Jun 17 11:45:59.578842 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 289/581] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:59 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1258 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:59.578842 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-764b3276-8e6d-41b9-b2de-8fe0d05ce248 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:59.578842 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-764b3276-8e6d-41b9-b2de-8fe0d05ce248 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:59.584631 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-764b3276-8e6d-41b9-b2de-8fe0d05ce248 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:59.585077 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-764b3276-8e6d-41b9-b2de-8fe0d05ce248 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:59.585855 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-764b3276-8e6d-41b9-b2de-8fe0d05ce248 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:59.586023 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5dcd7c31-08de-4295-85ef-607019f626f8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b" status: 200 len: 1365 microversion: 2.1 time: 0.314698 Jun 17 11:45:59.586654 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-764b3276-8e6d-41b9-b2de-8fe0d05ce248 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:59.586827 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 293/582] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:59 2022] GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b => generated 1365 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:59.591733 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-0d019517-87df-47a3-95b8-dbd27113ef95 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:59.592495 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-0d019517-87df-47a3-95b8-dbd27113ef95 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:59.600307 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0d019517-87df-47a3-95b8-dbd27113ef95 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:59.600904 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0d019517-87df-47a3-95b8-dbd27113ef95 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:59.601786 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0d019517-87df-47a3-95b8-dbd27113ef95 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:59.602306 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0d019517-87df-47a3-95b8-dbd27113ef95 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:59.825368 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-764b3276-8e6d-41b9-b2de-8fe0d05ce248 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:59.834736 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-0d019517-87df-47a3-95b8-dbd27113ef95 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:45:59.835542 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-764b3276-8e6d-41b9-b2de-8fe0d05ce248 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1357 microversion: 2.1 time: 0.263394 Jun 17 11:45:59.837694 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 290/583] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:59 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1357 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:59.843168 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-0d019517-87df-47a3-95b8-dbd27113ef95 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1675 microversion: 2.1 time: 0.255309 Jun 17 11:45:59.844323 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 294/584] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:59 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1675 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:45:59.934814 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-acaaea70-93eb-44eb-a35e-1f706b3a1360 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:45:59.935449 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-acaaea70-93eb-44eb-a35e-1f706b3a1360 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:45:59.942101 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-acaaea70-93eb-44eb-a35e-1f706b3a1360 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:59.942556 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-acaaea70-93eb-44eb-a35e-1f706b3a1360 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:45:59.943345 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-acaaea70-93eb-44eb-a35e-1f706b3a1360 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:45:59.943814 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-acaaea70-93eb-44eb-a35e-1f706b3a1360 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:00.123207 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-acaaea70-93eb-44eb-a35e-1f706b3a1360 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:00.132645 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-acaaea70-93eb-44eb-a35e-1f706b3a1360 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1688 microversion: 2.1 time: 0.201673 Jun 17 11:46:00.133305 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 291/585] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:45:59 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1688 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:00.295658 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d55cc3bf-f101-4425-870b-8f04a4da9488 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:00.296387 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d55cc3bf-f101-4425-870b-8f04a4da9488 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:00.304176 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d55cc3bf-f101-4425-870b-8f04a4da9488 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:00.304632 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d55cc3bf-f101-4425-870b-8f04a4da9488 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:00.305422 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d55cc3bf-f101-4425-870b-8f04a4da9488 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:00.305862 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d55cc3bf-f101-4425-870b-8f04a4da9488 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:00.463348 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d55cc3bf-f101-4425-870b-8f04a4da9488 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:00.473114 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d55cc3bf-f101-4425-870b-8f04a4da9488 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:00.474807 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d55cc3bf-f101-4425-870b-8f04a4da9488 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:00.475974 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d55cc3bf-f101-4425-870b-8f04a4da9488 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1406 microversion: 2.20 time: 0.184773 Jun 17 11:46:00.476544 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 295/586] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:46:00 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:46:00.589942 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0085cb04-1999-4ec9-9363-fd614b3e1374 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:00.590754 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0085cb04-1999-4ec9-9363-fd614b3e1374 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:00.599305 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0085cb04-1999-4ec9-9363-fd614b3e1374 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:00.599800 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0085cb04-1999-4ec9-9363-fd614b3e1374 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:00.600756 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0085cb04-1999-4ec9-9363-fd614b3e1374 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:00.601190 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0085cb04-1999-4ec9-9363-fd614b3e1374 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:00.604799 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ff5dd3dc-b12b-40f8-abe0-6eaa9fd09b3a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:00.605412 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ff5dd3dc-b12b-40f8-abe0-6eaa9fd09b3a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:00.613486 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ff5dd3dc-b12b-40f8-abe0-6eaa9fd09b3a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:00.613945 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ff5dd3dc-b12b-40f8-abe0-6eaa9fd09b3a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:00.614742 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ff5dd3dc-b12b-40f8-abe0-6eaa9fd09b3a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:00.615182 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ff5dd3dc-b12b-40f8-abe0-6eaa9fd09b3a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:00.834099 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0085cb04-1999-4ec9-9363-fd614b3e1374 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:00.842537 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0085cb04-1999-4ec9-9363-fd614b3e1374 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1258 microversion: 2.1 time: 0.256850 Jun 17 11:46:00.843182 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 292/587] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:00 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1258 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:00.847216 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ff5dd3dc-b12b-40f8-abe0-6eaa9fd09b3a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:00.861122 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c4a9e92c-f8ae-4248-9a4b-06bc8ea9b968 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:00.861738 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c4a9e92c-f8ae-4248-9a4b-06bc8ea9b968 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:00.864191 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ff5dd3dc-b12b-40f8-abe0-6eaa9fd09b3a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b" status: 200 len: 1365 microversion: 2.1 time: 0.262769 Jun 17 11:46:00.865310 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 296/588] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:00 2022] GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b => generated 1365 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:00.868371 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c4a9e92c-f8ae-4248-9a4b-06bc8ea9b968 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:00.868821 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c4a9e92c-f8ae-4248-9a4b-06bc8ea9b968 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:00.869597 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c4a9e92c-f8ae-4248-9a4b-06bc8ea9b968 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:00.870033 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c4a9e92c-f8ae-4248-9a4b-06bc8ea9b968 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:00.874128 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b6f48dba-5067-4557-8ef1-81016f6bbb5c tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:00.876367 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b6f48dba-5067-4557-8ef1-81016f6bbb5c tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:00.885683 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b6f48dba-5067-4557-8ef1-81016f6bbb5c tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:00.886558 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b6f48dba-5067-4557-8ef1-81016f6bbb5c tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:00.888042 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b6f48dba-5067-4557-8ef1-81016f6bbb5c tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:00.888735 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b6f48dba-5067-4557-8ef1-81016f6bbb5c tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:01.087144 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c4a9e92c-f8ae-4248-9a4b-06bc8ea9b968 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:01.095432 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c4a9e92c-f8ae-4248-9a4b-06bc8ea9b968 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1357 microversion: 2.1 time: 0.238606 Jun 17 11:46:01.096044 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 293/589] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:00 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1357 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:01.112593 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b6f48dba-5067-4557-8ef1-81016f6bbb5c tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:01.121076 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b6f48dba-5067-4557-8ef1-81016f6bbb5c tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1675 microversion: 2.1 time: 0.254017 Jun 17 11:46:01.121760 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 297/590] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:00 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1675 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:01.150272 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-683b46f8-0626-46bd-9b6d-99b25479ae39 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:01.150895 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-683b46f8-0626-46bd-9b6d-99b25479ae39 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:01.158482 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-683b46f8-0626-46bd-9b6d-99b25479ae39 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:01.158933 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-683b46f8-0626-46bd-9b6d-99b25479ae39 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:01.160004 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-683b46f8-0626-46bd-9b6d-99b25479ae39 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:01.160454 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-683b46f8-0626-46bd-9b6d-99b25479ae39 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:01.496950 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e4f80ae5-fa51-4d0c-9343-c9609192fc23 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:01.497573 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e4f80ae5-fa51-4d0c-9343-c9609192fc23 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:01.504008 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-683b46f8-0626-46bd-9b6d-99b25479ae39 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:01.505225 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e4f80ae5-fa51-4d0c-9343-c9609192fc23 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:01.505610 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e4f80ae5-fa51-4d0c-9343-c9609192fc23 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:01.506431 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e4f80ae5-fa51-4d0c-9343-c9609192fc23 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:01.506994 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e4f80ae5-fa51-4d0c-9343-c9609192fc23 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:01.518330 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-683b46f8-0626-46bd-9b6d-99b25479ae39 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1688 microversion: 2.1 time: 0.371951 Jun 17 11:46:01.518927 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 294/591] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:01 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1688 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:01.783113 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e4f80ae5-fa51-4d0c-9343-c9609192fc23 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:01.791997 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e4f80ae5-fa51-4d0c-9343-c9609192fc23 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:01.793635 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e4f80ae5-fa51-4d0c-9343-c9609192fc23 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:01.794794 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e4f80ae5-fa51-4d0c-9343-c9609192fc23 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1406 microversion: 2.20 time: 0.303257 Jun 17 11:46:01.795586 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 298/592] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:46:01 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1406 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:46:01.860875 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-98aa4620-fd9c-4387-a907-369f031cdc33 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:01.862028 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-98aa4620-fd9c-4387-a907-369f031cdc33 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:01.869061 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-98aa4620-fd9c-4387-a907-369f031cdc33 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:01.869587 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-98aa4620-fd9c-4387-a907-369f031cdc33 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:01.870419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-98aa4620-fd9c-4387-a907-369f031cdc33 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:01.870848 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-98aa4620-fd9c-4387-a907-369f031cdc33 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:01.883943 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3beb771f-3602-411b-a542-bf3ad5805026 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:01.884651 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-3beb771f-3602-411b-a542-bf3ad5805026 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:01.892789 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3beb771f-3602-411b-a542-bf3ad5805026 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:01.893319 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3beb771f-3602-411b-a542-bf3ad5805026 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:01.894334 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3beb771f-3602-411b-a542-bf3ad5805026 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:01.894822 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3beb771f-3602-411b-a542-bf3ad5805026 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:02.237369 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-98aa4620-fd9c-4387-a907-369f031cdc33 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:02.253733 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-98aa4620-fd9c-4387-a907-369f031cdc33 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1258 microversion: 2.1 time: 0.397348 Jun 17 11:46:02.254392 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 295/593] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:01 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1258 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:02.277662 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c9a44f01-4a2f-4f1c-86cf-a3c3925732cd tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:02.278665 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c9a44f01-4a2f-4f1c-86cf-a3c3925732cd tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:02.290555 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c9a44f01-4a2f-4f1c-86cf-a3c3925732cd tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:02.291312 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c9a44f01-4a2f-4f1c-86cf-a3c3925732cd tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:02.292982 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c9a44f01-4a2f-4f1c-86cf-a3c3925732cd tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:02.294377 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c9a44f01-4a2f-4f1c-86cf-a3c3925732cd tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:02.322908 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3beb771f-3602-411b-a542-bf3ad5805026 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:02.353736 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-3beb771f-3602-411b-a542-bf3ad5805026 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b" status: 200 len: 1554 microversion: 2.1 time: 0.473676 Jun 17 11:46:02.355471 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 299/594] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:01 2022] GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b => generated 1554 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:02.374188 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-eb9d162b-5915-4b13-8bd7-997d7650c536 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:02.380037 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-eb9d162b-5915-4b13-8bd7-997d7650c536 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:02.392123 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-eb9d162b-5915-4b13-8bd7-997d7650c536 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:02.393861 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-eb9d162b-5915-4b13-8bd7-997d7650c536 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:02.395412 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-eb9d162b-5915-4b13-8bd7-997d7650c536 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:02.396556 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-eb9d162b-5915-4b13-8bd7-997d7650c536 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:02.582314 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c9a44f01-4a2f-4f1c-86cf-a3c3925732cd tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:02.592935 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c9a44f01-4a2f-4f1c-86cf-a3c3925732cd tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1357 microversion: 2.1 time: 0.322134 Jun 17 11:46:02.595531 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 296/595] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:02 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1357 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:02.613459 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-fedc320f-863a-41fa-a5d2-da564024100d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:02.617071 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-fedc320f-863a-41fa-a5d2-da564024100d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:02.625008 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fedc320f-863a-41fa-a5d2-da564024100d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:02.625837 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fedc320f-863a-41fa-a5d2-da564024100d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:02.626871 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fedc320f-863a-41fa-a5d2-da564024100d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:02.630776 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fedc320f-863a-41fa-a5d2-da564024100d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:02.813822 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-fedc320f-863a-41fa-a5d2-da564024100d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.215732 Jun 17 11:46:02.815513 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 297/596] 10.222.0.45 () {58 vars in 1274 bytes} [Fri Jun 17 11:46:02 2022] GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b/os-interface => generated 284 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:46:02.825350 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-065cb81a-93bd-48f5-8639-86780c6d3227 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:02.830892 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-065cb81a-93bd-48f5-8639-86780c6d3227 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:02.834689 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-065cb81a-93bd-48f5-8639-86780c6d3227 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:02.835155 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-065cb81a-93bd-48f5-8639-86780c6d3227 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:02.836100 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-065cb81a-93bd-48f5-8639-86780c6d3227 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:02.836509 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-065cb81a-93bd-48f5-8639-86780c6d3227 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:03.136225 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-eb9d162b-5915-4b13-8bd7-997d7650c536 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:03.149770 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-eb9d162b-5915-4b13-8bd7-997d7650c536 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1675 microversion: 2.1 time: 0.787603 Jun 17 11:46:03.154098 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 300/597] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:02 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1675 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:03.159840 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-25f30053-269d-46f9-8183-a3c2ffc3d33e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:03.160811 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-25f30053-269d-46f9-8183-a3c2ffc3d33e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:03.168315 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-25f30053-269d-46f9-8183-a3c2ffc3d33e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:03.168871 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-25f30053-269d-46f9-8183-a3c2ffc3d33e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:03.169746 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-25f30053-269d-46f9-8183-a3c2ffc3d33e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:03.170258 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-25f30053-269d-46f9-8183-a3c2ffc3d33e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:03.233639 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-065cb81a-93bd-48f5-8639-86780c6d3227 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:03.244900 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-065cb81a-93bd-48f5-8639-86780c6d3227 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1621 microversion: 2.1 time: 0.428028 Jun 17 11:46:03.246772 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 298/598] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:02 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1621 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:03.285242 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-5cc0073d-2d9a-4079-8d28-3d6bc8d9a792 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:03.285858 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-5cc0073d-2d9a-4079-8d28-3d6bc8d9a792 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:03.292337 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5cc0073d-2d9a-4079-8d28-3d6bc8d9a792 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:03.293073 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5cc0073d-2d9a-4079-8d28-3d6bc8d9a792 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:03.294162 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5cc0073d-2d9a-4079-8d28-3d6bc8d9a792 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:03.294598 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5cc0073d-2d9a-4079-8d28-3d6bc8d9a792 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:03.642082 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-25f30053-269d-46f9-8183-a3c2ffc3d33e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:03.660798 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-25f30053-269d-46f9-8183-a3c2ffc3d33e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:03.662725 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-25f30053-269d-46f9-8183-a3c2ffc3d33e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:03.664202 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-25f30053-269d-46f9-8183-a3c2ffc3d33e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1406 microversion: 2.20 time: 0.508472 Jun 17 11:46:03.676077 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 301/599] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:46:03 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1406 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:46:03.683424 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5cc0073d-2d9a-4079-8d28-3d6bc8d9a792 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:03.714998 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-5cc0073d-2d9a-4079-8d28-3d6bc8d9a792 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1258 microversion: 2.1 time: 0.433777 Jun 17 11:46:03.717297 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a6a5ec20-7902-40ff-8cae-3ffee4e3f3ca tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:03.717297 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a6a5ec20-7902-40ff-8cae-3ffee4e3f3ca tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:03.718134 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 299/600] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:03 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1258 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:46:03.726223 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a6a5ec20-7902-40ff-8cae-3ffee4e3f3ca tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:03.726981 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a6a5ec20-7902-40ff-8cae-3ffee4e3f3ca tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:03.727934 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a6a5ec20-7902-40ff-8cae-3ffee4e3f3ca tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:03.728618 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a6a5ec20-7902-40ff-8cae-3ffee4e3f3ca tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:03.759381 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-e8d4f9bc-673f-446d-bc66-6333d82ea981 req-63409bda-6179-43cb-a382-7a74ffda1317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a27dd59-4638-430d-a484-d38ed6fcf923", "name": "network-vif-deleted", "tag": "673fb82d-43c8-4e9f-bf01-47ee2806f33a"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:46:03.772952 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-e8d4f9bc-673f-446d-bc66-6333d82ea981 req-63409bda-6179-43cb-a382-7a74ffda1317 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:03.773620 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-e8d4f9bc-673f-446d-bc66-6333d82ea981 req-63409bda-6179-43cb-a382-7a74ffda1317 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:03.790456 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-e8d4f9bc-673f-446d-bc66-6333d82ea981 req-63409bda-6179-43cb-a382-7a74ffda1317 service nova] Creating event network-vif-deleted:673fb82d-43c8-4e9f-bf01-47ee2806f33a for instance 9a27dd59-4638-430d-a484-d38ed6fcf923 on hv-cinder-83716 Jun 17 11:46:03.796878 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-e8d4f9bc-673f-446d-bc66-6333d82ea981 req-63409bda-6179-43cb-a382-7a74ffda1317 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043082 Jun 17 11:46:03.798799 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 300/601] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:46:04.021440 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a6a5ec20-7902-40ff-8cae-3ffee4e3f3ca tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:04.030680 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a6a5ec20-7902-40ff-8cae-3ffee4e3f3ca tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1546 microversion: 2.1 time: 0.353380 Jun 17 11:46:04.031727 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 302/602] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:03 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1546 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:04.048791 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b5a26a6a-7bd3-4255-a01a-41ef857cb01c tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:04.049847 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b5a26a6a-7bd3-4255-a01a-41ef857cb01c tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:04.057928 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b5a26a6a-7bd3-4255-a01a-41ef857cb01c tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:04.058759 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b5a26a6a-7bd3-4255-a01a-41ef857cb01c tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:04.059816 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b5a26a6a-7bd3-4255-a01a-41ef857cb01c tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:04.060468 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b5a26a6a-7bd3-4255-a01a-41ef857cb01c tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:04.263687 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b5a26a6a-7bd3-4255-a01a-41ef857cb01c tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:04.287712 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b5a26a6a-7bd3-4255-a01a-41ef857cb01c tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1546 microversion: 2.1 time: 0.243465 Jun 17 11:46:04.300227 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 301/603] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:04 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1546 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:04.319895 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-cd460e62-4049-4801-8cef-345d0eb9b53f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:04.320520 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-cd460e62-4049-4801-8cef-345d0eb9b53f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:04.327877 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cd460e62-4049-4801-8cef-345d0eb9b53f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:04.328383 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cd460e62-4049-4801-8cef-345d0eb9b53f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:04.329377 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cd460e62-4049-4801-8cef-345d0eb9b53f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:04.330085 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cd460e62-4049-4801-8cef-345d0eb9b53f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:04.340192 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ef5b590d-bdcd-4c5c-9ab0-a00553615415 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:04.341543 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ef5b590d-bdcd-4c5c-9ab0-a00553615415 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:04.355940 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ef5b590d-bdcd-4c5c-9ab0-a00553615415 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:04.356637 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ef5b590d-bdcd-4c5c-9ab0-a00553615415 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:04.358355 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ef5b590d-bdcd-4c5c-9ab0-a00553615415 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:04.364747 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ef5b590d-bdcd-4c5c-9ab0-a00553615415 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:04.400323 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=100 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:46:04.415943 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-cd460e62-4049-4801-8cef-345d0eb9b53f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:04.431011 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-cd460e62-4049-4801-8cef-345d0eb9b53f tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1330 microversion: 2.1 time: 0.127727 Jun 17 11:46:04.432762 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 302/604] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:04 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1330 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:04.444567 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6ab1f6b4-a9b0-46ca-94c3-e18ff5f8f22d tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:04.455114 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ef5b590d-bdcd-4c5c-9ab0-a00553615415 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:04.455305 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6ab1f6b4-a9b0-46ca-94c3-e18ff5f8f22d tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:04.456533 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-6ab1f6b4-a9b0-46ca-94c3-e18ff5f8f22d tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Searching by: {'deleted': False, 'project_id': '6466d6627209487ca62377eb7aa5d9e4'} {{(pid=124845) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 17 11:46:04.463812 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ef5b590d-bdcd-4c5c-9ab0-a00553615415 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1607 microversion: 2.1 time: 0.297153 Jun 17 11:46:04.465309 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 303/605] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:04 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1607 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:04.483746 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6ab1f6b4-a9b0-46ca-94c3-e18ff5f8f22d tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:04.488150 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6ab1f6b4-a9b0-46ca-94c3-e18ff5f8f22d tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:04.488150 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6ab1f6b4-a9b0-46ca-94c3-e18ff5f8f22d tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:04.488519 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6ab1f6b4-a9b0-46ca-94c3-e18ff5f8f22d tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:04.592058 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-0d84b456-8e11-472d-87fd-53ca37e5e890 req-221088d1-885f-424d-ac64-a51320518c2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8cd69a4-437d-4db2-bd02-b485b06773e2", "name": "network-vif-deleted", "tag": "c8a5211f-0d5a-4f8f-a4a6-9d9fe6173ce8"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:46:04.604443 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-0d84b456-8e11-472d-87fd-53ca37e5e890 req-221088d1-885f-424d-ac64-a51320518c2d service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:04.615342 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-0d84b456-8e11-472d-87fd-53ca37e5e890 req-221088d1-885f-424d-ac64-a51320518c2d service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:04.629851 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.multi_cell_list [None req-6ab1f6b4-a9b0-46ca-94c3-e18ff5f8f22d tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124845) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 17 11:46:04.637692 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-0d84b456-8e11-472d-87fd-53ca37e5e890 req-221088d1-885f-424d-ac64-a51320518c2d service nova] Creating event network-vif-deleted:c8a5211f-0d5a-4f8f-a4a6-9d9fe6173ce8 for instance b8cd69a4-437d-4db2-bd02-b485b06773e2 on hv-cinder-83716 Jun 17 11:46:04.646739 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-0d84b456-8e11-472d-87fd-53ca37e5e890 req-221088d1-885f-424d-ac64-a51320518c2d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066929 Jun 17 11:46:04.648231 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 304/606] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:46:04.685511 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-08e63964-3533-41a5-a932-6cd00b5c704a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:04.692990 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-08e63964-3533-41a5-a932-6cd00b5c704a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:04.719912 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-08e63964-3533-41a5-a932-6cd00b5c704a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:04.720139 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-08e63964-3533-41a5-a932-6cd00b5c704a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:04.721071 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-08e63964-3533-41a5-a932-6cd00b5c704a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:04.723875 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-08e63964-3533-41a5-a932-6cd00b5c704a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:04.827353 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-6ab1f6b4-a9b0-46ca-94c3-e18ff5f8f22d tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.392752 Jun 17 11:46:04.829176 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 303/607] 10.222.0.45 () {58 vars in 1124 bytes} [Fri Jun 17 11:46:04 2022] GET /compute/v2.1/servers => generated 342 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:46:04.834834 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-fe53737f-07d1-49f1-91d5-25c05a1cefca tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:04.835506 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-fe53737f-07d1-49f1-91d5-25c05a1cefca tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:04.842366 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fe53737f-07d1-49f1-91d5-25c05a1cefca tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:04.842822 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fe53737f-07d1-49f1-91d5-25c05a1cefca tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:04.843635 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fe53737f-07d1-49f1-91d5-25c05a1cefca tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:04.844653 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fe53737f-07d1-49f1-91d5-25c05a1cefca tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:05.090886 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-fe53737f-07d1-49f1-91d5-25c05a1cefca tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:05.093050 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-08e63964-3533-41a5-a932-6cd00b5c704a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:05.101683 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-08e63964-3533-41a5-a932-6cd00b5c704a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:05.102635 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-fe53737f-07d1-49f1-91d5-25c05a1cefca tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1258 microversion: 2.1 time: 0.271380 Jun 17 11:46:05.104012 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 304/608] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:04 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1258 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:05.113810 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e63f6c57-dfaa-4227-b596-fe385d05d14b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:05.115247 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-e63f6c57-dfaa-4227-b596-fe385d05d14b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:05.116962 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-08e63964-3533-41a5-a932-6cd00b5c704a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:05.119168 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-08e63964-3533-41a5-a932-6cd00b5c704a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1406 microversion: 2.20 time: 0.440291 Jun 17 11:46:05.122312 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 305/609] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:46:04 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1406 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:46:05.130233 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e63f6c57-dfaa-4227-b596-fe385d05d14b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:05.131696 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e63f6c57-dfaa-4227-b596-fe385d05d14b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:05.133749 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e63f6c57-dfaa-4227-b596-fe385d05d14b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:05.134855 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e63f6c57-dfaa-4227-b596-fe385d05d14b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:05.341285 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-e63f6c57-dfaa-4227-b596-fe385d05d14b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:05.353192 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-e63f6c57-dfaa-4227-b596-fe385d05d14b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1546 microversion: 2.1 time: 0.247790 Jun 17 11:46:05.360983 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 305/610] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:05 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1546 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:05.449467 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-69b887ac-8671-4070-8a97-d15c228485f1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:05.450858 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-69b887ac-8671-4070-8a97-d15c228485f1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:05.457964 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-69b887ac-8671-4070-8a97-d15c228485f1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:05.458723 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-69b887ac-8671-4070-8a97-d15c228485f1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:05.459781 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-69b887ac-8671-4070-8a97-d15c228485f1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:05.460401 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-69b887ac-8671-4070-8a97-d15c228485f1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:05.497270 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4db56bfb-a2f0-4058-9720-994e7436b8f4 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:05.498052 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4db56bfb-a2f0-4058-9720-994e7436b8f4 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:05.512171 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4db56bfb-a2f0-4058-9720-994e7436b8f4 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:05.512832 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4db56bfb-a2f0-4058-9720-994e7436b8f4 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:05.515086 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4db56bfb-a2f0-4058-9720-994e7436b8f4 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:05.518070 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4db56bfb-a2f0-4058-9720-994e7436b8f4 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:05.527701 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-69b887ac-8671-4070-8a97-d15c228485f1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:05.528159 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-69b887ac-8671-4070-8a97-d15c228485f1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:05.528616 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-69b887ac-8671-4070-8a97-d15c228485f1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lazy-loading 'fault' on Instance uuid 9a27dd59-4638-430d-a484-d38ed6fcf923 {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:46:05.585080 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4db56bfb-a2f0-4058-9720-994e7436b8f4 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:05.590013 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4db56bfb-a2f0-4058-9720-994e7436b8f4 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:05.590481 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-4db56bfb-a2f0-4058-9720-994e7436b8f4 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lazy-loading 'fault' on Instance uuid b8cd69a4-437d-4db2-bd02-b485b06773e2 {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:46:05.593793 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=100 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:46:05.599846 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-69b887ac-8671-4070-8a97-d15c228485f1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:05.607793 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-69b887ac-8671-4070-8a97-d15c228485f1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 200 len: 1335 microversion: 2.1 time: 0.162063 Jun 17 11:46:05.613876 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 306/611] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:05 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 1335 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:05.652657 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-4db56bfb-a2f0-4058-9720-994e7436b8f4 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:05.662354 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4db56bfb-a2f0-4058-9720-994e7436b8f4 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 200 len: 1328 microversion: 2.1 time: 0.171293 Jun 17 11:46:05.663416 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 306/612] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:05 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 1328 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:06.131293 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b6299e8e-20f5-4ad5-bf65-8c638be9d148 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:06.132840 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b6299e8e-20f5-4ad5-bf65-8c638be9d148 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:06.145098 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0a2e60f1-2d50-48f1-abe4-cebcccedd310 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:06.145997 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0a2e60f1-2d50-48f1-abe4-cebcccedd310 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:06.154755 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b6299e8e-20f5-4ad5-bf65-8c638be9d148 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:06.155475 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b6299e8e-20f5-4ad5-bf65-8c638be9d148 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:06.159017 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0a2e60f1-2d50-48f1-abe4-cebcccedd310 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:06.161269 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0a2e60f1-2d50-48f1-abe4-cebcccedd310 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:06.163299 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0a2e60f1-2d50-48f1-abe4-cebcccedd310 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:06.164717 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b6299e8e-20f5-4ad5-bf65-8c638be9d148 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:06.164977 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0a2e60f1-2d50-48f1-abe4-cebcccedd310 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:06.165115 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b6299e8e-20f5-4ad5-bf65-8c638be9d148 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:06.437486 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0a2e60f1-2d50-48f1-abe4-cebcccedd310 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:06.455596 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0a2e60f1-2d50-48f1-abe4-cebcccedd310 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:06.459029 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0a2e60f1-2d50-48f1-abe4-cebcccedd310 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:06.461250 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0a2e60f1-2d50-48f1-abe4-cebcccedd310 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1598 microversion: 2.20 time: 0.323323 Jun 17 11:46:06.484228 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 307/613] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:46:06 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1598 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:46:06.493401 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-55079502-658b-458b-a52c-f9381ba45796 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:06.495420 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-55079502-658b-458b-a52c-f9381ba45796 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:06.500751 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b6299e8e-20f5-4ad5-bf65-8c638be9d148 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:06.504961 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-55079502-658b-458b-a52c-f9381ba45796 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:06.505844 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-55079502-658b-458b-a52c-f9381ba45796 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:06.507154 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-55079502-658b-458b-a52c-f9381ba45796 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:06.508578 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-55079502-658b-458b-a52c-f9381ba45796 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:06.528673 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b6299e8e-20f5-4ad5-bf65-8c638be9d148 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1258 microversion: 2.1 time: 0.395756 Jun 17 11:46:06.529975 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 307/614] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:06 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1258 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:06.632341 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d2216795-7459-47f0-b982-70010456838d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:06.634000 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-55079502-658b-458b-a52c-f9381ba45796 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.146008 Jun 17 11:46:06.634000 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 308/615] 10.222.0.45 () {60 vars in 1315 bytes} [Fri Jun 17 11:46:06 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d/os-interface => generated 285 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 11:46:06.635114 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d2216795-7459-47f0-b982-70010456838d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 9a27dd59-4638-430d-a484-d38ed6fcf923] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:06.652960 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d2216795-7459-47f0-b982-70010456838d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:06.653663 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d2216795-7459-47f0-b982-70010456838d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:06.654653 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d2216795-7459-47f0-b982-70010456838d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:06.655091 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d2216795-7459-47f0-b982-70010456838d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:06.674553 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-810e1214-b96f-4551-9cdc-c48b32aae392 req-4620a320-3370-4483-abbd-e16b26d3c6fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b705046-ed66-4a09-9354-18ee01d1676b", "tag": "59a1be8f-e417-465c-8536-98f4405514f7"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:46:06.676940 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-d2216795-7459-47f0-b982-70010456838d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] HTTP exception thrown: Instance 9a27dd59-4638-430d-a484-d38ed6fcf923 could not be found. Jun 17 11:46:06.678661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d2216795-7459-47f0-b982-70010456838d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Request method failure captured: Jun 17 11:46:06.678661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: request: GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 HTTP/1.1 Jun 17 11:46:06.678661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept: application/json Jun 17 11:46:06.678661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jun 17 11:46:06.678661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Connection: close Jun 17 11:46:06.678661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jun 17 11:46:06.678661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jun 17 11:46:06.678661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Host: 10.222.0.45 Jun 17 11:46:06.678661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jun 17 11:46:06.678661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jun 17 11:46:06.678661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABirGhYXPEneGbWlDHr4IdGyKcI2lSvyu7_ndCScBUrORne39u-qQqZEMZQFH6SJDovDOcnVKjNuoxzr715SnSXgShkw-ZY_5pruDdyzsw0BrOMIBFmyx6bizWQou_OUbd6ovLhc1PtNOl8-D1aQsyvMYXlGV0IY28idRqZ__sES5ASbXg Jun 17 11:46:06.678661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jun 17 11:46:06.678661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jun 17 11:46:06.678661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jun 17 11:46:06.678661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jun 17 11:46:06.678661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jun 17 11:46:06.678661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jun 17 11:46:06.678661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Id: e38262ed2ed84004a6e01d423cadcae4 Jun 17 11:46:06.678661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1413190309 Jun 17 11:46:06.678661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Role: member,reader Jun 17 11:46:06.678661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Roles: member,reader Jun 17 11:46:06.681194 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e38262ed2ed84004a6e01d423cadcae4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e38262ed2ed84004a6e01d423cadcae4", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e38262ed2ed84004a6e01d423cadcae4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e38262ed2ed84004a6e01d423cadcae4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:46:06.681194 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1413190309 Jun 17 11:46:06.681194 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Id: e38262ed2ed84004a6e01d423cadcae4 Jun 17 11:46:06.681194 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1413190309 Jun 17 11:46:06.681194 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User: tempest-ServerRescueNegativeTestJSON-1413190309-project Jun 17 11:46:06.681194 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jun 17 11:46:06.681194 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jun 17 11:46:06.681194 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Id: a79957b3f2e94f31bd2cb82290ed0962 Jun 17 11:46:06.681194 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1413190309-project Jun 17 11:46:06.681194 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: method: > Jun 17 11:46:06.681194 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: exception: Instance 9a27dd59-4638-430d-a484-d38ed6fcf923 could not be found. Jun 17 11:46:06.681194 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: action_args: {'id': '9a27dd59-4638-430d-a484-d38ed6fcf923'} Jun 17 11:46:06.682726 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:46:06.682726 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:46:06.682726 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:46:06.682726 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:46:06.682726 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:46:06.682726 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:46:06.682726 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:46:06.682726 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:46:06.682726 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:46:06.682726 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:46:06.682726 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a27dd59-4638-430d-a484-d38ed6fcf923 could not be found. Jun 17 11:46:06.682726 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:46:06.682726 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:46:06.682726 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:46:06.682726 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:46:06.682726 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:46:06.682726 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:46:06.682726 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:46:06.682726 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:46:06.682726 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:46:06.685168 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:46:06.685168 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 11:46:06.685168 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 11:46:06.685168 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:46:06.685168 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:46:06.685168 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:46:06.685168 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:46:06.685168 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a27dd59-4638-430d-a484-d38ed6fcf923 could not be found. Jun 17 11:46:06.685168 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:46:06.685168 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:46:06.685168 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:46:06.685168 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:46:06.685168 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:46:06.685168 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:46:06.685168 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:46:06.685168 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:46:06.685168 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a27dd59-4638-430d-a484-d38ed6fcf923 could not be found. Jun 17 11:46:06.685168 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:46:06.687360 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d2216795-7459-47f0-b982-70010456838d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Returning 404 to user: Instance 9a27dd59-4638-430d-a484-d38ed6fcf923 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:46:06.687360 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d2216795-7459-47f0-b982-70010456838d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923" status: 404 len: 111 microversion: 2.1 time: 0.051947 Jun 17 11:46:06.691844 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 308/616] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:06 2022] GET /compute/v2.1/servers/9a27dd59-4638-430d-a484-d38ed6fcf923 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:46:06.692372 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-810e1214-b96f-4551-9cdc-c48b32aae392 req-4620a320-3370-4483-abbd-e16b26d3c6fc service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:06.693158 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-810e1214-b96f-4551-9cdc-c48b32aae392 req-4620a320-3370-4483-abbd-e16b26d3c6fc service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:06.699722 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-9a007850-2483-40c7-808e-a05681ec9502 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:06.700449 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-9a007850-2483-40c7-808e-a05681ec9502 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:06.721357 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9a007850-2483-40c7-808e-a05681ec9502 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:06.722108 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9a007850-2483-40c7-808e-a05681ec9502 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:06.723346 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9a007850-2483-40c7-808e-a05681ec9502 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:06.724093 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9a007850-2483-40c7-808e-a05681ec9502 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:06.743743 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-9a007850-2483-40c7-808e-a05681ec9502 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] HTTP exception thrown: Instance b8cd69a4-437d-4db2-bd02-b485b06773e2 could not be found. Jun 17 11:46:06.746549 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-810e1214-b96f-4551-9cdc-c48b32aae392 req-4620a320-3370-4483-abbd-e16b26d3c6fc service nova] Creating event network-changed:59a1be8f-e417-465c-8536-98f4405514f7 for instance 4b705046-ed66-4a09-9354-18ee01d1676b on hv-cinder-83716 Jun 17 11:46:06.747133 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-9a007850-2483-40c7-808e-a05681ec9502 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Request method failure captured: Jun 17 11:46:06.747133 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: request: GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 HTTP/1.1 Jun 17 11:46:06.747133 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept: application/json Jun 17 11:46:06.747133 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jun 17 11:46:06.747133 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Connection: close Jun 17 11:46:06.747133 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jun 17 11:46:06.747133 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jun 17 11:46:06.747133 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Host: 10.222.0.45 Jun 17 11:46:06.747133 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jun 17 11:46:06.747133 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jun 17 11:46:06.747133 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABirGhQQ3IJvv2fai7On2SBVJl_m9m3AYw-cTGmCzOCcME6LK5cL8D62JHLQnt2J3JIvrIZ98xWBbJa3BnXTQQwPhM9HIAnuJPtaYHwR6Zw9rsrisXV3AituD6-4T-j-g0n_VQsenJYLpsnbGsNw3t4zRf1_cCdpskb_SoViAyw28PLi78 Jun 17 11:46:06.747133 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jun 17 11:46:06.747133 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jun 17 11:46:06.747133 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jun 17 11:46:06.747133 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jun 17 11:46:06.747133 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jun 17 11:46:06.747133 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jun 17 11:46:06.747133 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Id: b35e2c02ed78431fbbc93d3da1a7caba Jun 17 11:46:06.747133 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-AttachVolumeTestJSON-1843768207 Jun 17 11:46:06.747133 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Role: member,reader Jun 17 11:46:06.747133 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Roles: member,reader Jun 17 11:46:06.748688 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b35e2c02ed78431fbbc93d3da1a7caba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b35e2c02ed78431fbbc93d3da1a7caba", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b35e2c02ed78431fbbc93d3da1a7caba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b35e2c02ed78431fbbc93d3da1a7caba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:46:06.748688 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-AttachVolumeTestJSON-1843768207 Jun 17 11:46:06.748688 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Id: b35e2c02ed78431fbbc93d3da1a7caba Jun 17 11:46:06.748688 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1843768207 Jun 17 11:46:06.748688 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User: tempest-AttachVolumeTestJSON-1843768207-project Jun 17 11:46:06.748688 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jun 17 11:46:06.748688 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jun 17 11:46:06.748688 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Id: f78027ac3a2c463fbe14da8443a09761 Jun 17 11:46:06.748688 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-AttachVolumeTestJSON-1843768207-project Jun 17 11:46:06.748688 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: method: > Jun 17 11:46:06.748688 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: exception: Instance b8cd69a4-437d-4db2-bd02-b485b06773e2 could not be found. Jun 17 11:46:06.748688 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: action_args: {'id': 'b8cd69a4-437d-4db2-bd02-b485b06773e2'} Jun 17 11:46:06.750310 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:46:06.750310 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:46:06.750310 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:46:06.750310 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:46:06.750310 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:46:06.750310 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:46:06.750310 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:46:06.750310 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:46:06.750310 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:46:06.750310 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:46:06.750310 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8cd69a4-437d-4db2-bd02-b485b06773e2 could not be found. Jun 17 11:46:06.750310 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:46:06.750310 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:46:06.750310 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:46:06.750310 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:46:06.750310 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:46:06.750310 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:46:06.750310 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:46:06.750310 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:46:06.750310 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:46:06.752492 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:46:06.752492 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 11:46:06.752492 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 11:46:06.752492 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:46:06.752492 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:46:06.752492 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:46:06.752492 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:46:06.752492 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8cd69a4-437d-4db2-bd02-b485b06773e2 could not be found. Jun 17 11:46:06.752492 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:46:06.752492 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:46:06.752492 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:46:06.752492 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:46:06.752492 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:46:06.752492 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:46:06.752492 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:46:06.752492 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:46:06.752492 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8cd69a4-437d-4db2-bd02-b485b06773e2 could not be found. Jun 17 11:46:06.752492 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:46:06.756936 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-9a007850-2483-40c7-808e-a05681ec9502 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Returning 404 to user: Instance b8cd69a4-437d-4db2-bd02-b485b06773e2 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:46:06.758614 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-9a007850-2483-40c7-808e-a05681ec9502 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 404 len: 111 microversion: 2.1 time: 0.068208 Jun 17 11:46:06.763157 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-810e1214-b96f-4551-9cdc-c48b32aae392 req-4620a320-3370-4483-abbd-e16b26d3c6fc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091664 Jun 17 11:46:06.763157 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 309/617] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:46:06.766476 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 309/618] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:06 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:46:06.772493 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-86c7d160-313e-4f80-8777-f9742613bde2 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '.version_select at 0x7f9c7681b310>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:06.778643 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-514a7d70-a033-4322-ad21-941476d819b5 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '.version_select at 0x7f9c767c3a60>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:06.785315 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:46:06.911664 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-514a7d70-a033-4322-ad21-941476d819b5 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1615188127" status: 202 len: 0 microversion: 2.1 time: 0.147078 Jun 17 11:46:06.912838 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 310/619] 10.222.0.45 () {58 vars in 1220 bytes} [Fri Jun 17 11:46:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1615188127 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 11:46:06.918671 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-86c7d160-313e-4f80-8777-f9742613bde2 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1770682285" status: 202 len: 0 microversion: 2.1 time: 0.149902 Jun 17 11:46:06.925560 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 310/620] 10.222.0.45 () {58 vars in 1220 bytes} [Fri Jun 17 11:46:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1770682285 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 11:46:07.560636 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4e0ef936-5eb6-421c-a7dc-bfc3b2f580ec tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:07.561452 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4e0ef936-5eb6-421c-a7dc-bfc3b2f580ec tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:07.570126 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4e0ef936-5eb6-421c-a7dc-bfc3b2f580ec tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:07.570793 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4e0ef936-5eb6-421c-a7dc-bfc3b2f580ec tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:07.571797 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4e0ef936-5eb6-421c-a7dc-bfc3b2f580ec tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:07.572403 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4e0ef936-5eb6-421c-a7dc-bfc3b2f580ec tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:07.711848 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1eb1748c-9879-4b34-b510-2e8db39cf5d9 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "382e54ac-75b5-4fbc-98bb-c2fe33077bb1"}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:46:07.713042 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-1eb1748c-9879-4b34-b510-2e8db39cf5d9 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:07.721430 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1eb1748c-9879-4b34-b510-2e8db39cf5d9 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:07.722221 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1eb1748c-9879-4b34-b510-2e8db39cf5d9 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:07.724635 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1eb1748c-9879-4b34-b510-2e8db39cf5d9 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:07.724635 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1eb1748c-9879-4b34-b510-2e8db39cf5d9 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:08.073326 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-4e0ef936-5eb6-421c-a7dc-bfc3b2f580ec tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:08.082184 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4e0ef936-5eb6-421c-a7dc-bfc3b2f580ec tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1258 microversion: 2.1 time: 0.525563 Jun 17 11:46:08.090515 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 311/621] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:07 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1258 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:08.676317 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-1eb1748c-9879-4b34-b510-2e8db39cf5d9 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "POST /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.969230 Jun 17 11:46:08.677088 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 311/622] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jun 17 11:46:07 2022] POST /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments => generated 194 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:46:08.820109 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-f684cd53-a0cd-469a-a1f4-ddaf49ce11df req-8fd25073-2152-421a-a21e-cf6f31d77f7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4eb9c8c-b733-475e-b69e-279e9295ac4d", "tag": "f00e28a8-041d-4c99-8685-2e89673ad6b8"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:46:08.830606 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-f684cd53-a0cd-469a-a1f4-ddaf49ce11df req-8fd25073-2152-421a-a21e-cf6f31d77f7a service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:08.831051 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-f684cd53-a0cd-469a-a1f4-ddaf49ce11df req-8fd25073-2152-421a-a21e-cf6f31d77f7a service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:08.844593 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-f684cd53-a0cd-469a-a1f4-ddaf49ce11df req-8fd25073-2152-421a-a21e-cf6f31d77f7a service nova] Creating event network-changed:f00e28a8-041d-4c99-8685-2e89673ad6b8 for instance f4eb9c8c-b733-475e-b69e-279e9295ac4d on hv-cinder-83716 Jun 17 11:46:08.850371 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-f684cd53-a0cd-469a-a1f4-ddaf49ce11df req-8fd25073-2152-421a-a21e-cf6f31d77f7a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033909 Jun 17 11:46:08.851661 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 312/623] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:46:08.862353 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6d4b447a-193c-4c18-9df4-9ff7e77e2fe3 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Action: 'create', calling method: .version_select at 0x7f9c767d1c10>, body: {"keypair": {"name": "tempest-keypair-972361664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPirVO/eyiFHOO775Zgv6v156VzEtDj8bWw7S5PGqr03TrsQ1HBbhYFsmYUD2a1Mj+5lPSFOOu8wkgsrW3UeLyuNVfE4jW/OGiXeU6iUl1VG3P+mkxBvzpdglfczEI3+g=="}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:46:08.880834 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-6d4b447a-193c-4c18-9df4-9ff7e77e2fe3 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Getting quotas for project b35e2c02ed78431fbbc93d3da1a7caba. Resources: {'key_pairs'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 11:46:08.886083 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-6d4b447a-193c-4c18-9df4-9ff7e77e2fe3 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Getting quotas for user f78027ac3a2c463fbe14da8443a09761 and project b35e2c02ed78431fbbc93d3da1a7caba. Resources: {'key_pairs'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 11:46:09.101194 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-89303b7c-4a8d-4c45-9ee7-7aadaa6fdfa1 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:09.102016 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-89303b7c-4a8d-4c45-9ee7-7aadaa6fdfa1 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:09.104239 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:46:09.109624 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-89303b7c-4a8d-4c45-9ee7-7aadaa6fdfa1 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:09.110198 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-89303b7c-4a8d-4c45-9ee7-7aadaa6fdfa1 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:09.111534 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-89303b7c-4a8d-4c45-9ee7-7aadaa6fdfa1 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:09.111799 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-89303b7c-4a8d-4c45-9ee7-7aadaa6fdfa1 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:09.144624 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-6d4b447a-193c-4c18-9df4-9ff7e77e2fe3 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.287913 Jun 17 11:46:09.145501 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 312/624] 10.222.0.45 () {60 vars in 1158 bytes} [Fri Jun 17 11:46:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:46:09.290266 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-89303b7c-4a8d-4c45-9ee7-7aadaa6fdfa1 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:09.301630 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-89303b7c-4a8d-4c45-9ee7-7aadaa6fdfa1 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1258 microversion: 2.1 time: 0.204536 Jun 17 11:46:09.302689 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 313/625] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:09 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1258 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:46:10.319290 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-79d2fb14-1a26-4464-873d-431ecbac0409 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:10.320012 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-79d2fb14-1a26-4464-873d-431ecbac0409 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:10.328041 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-79d2fb14-1a26-4464-873d-431ecbac0409 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:10.329017 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-79d2fb14-1a26-4464-873d-431ecbac0409 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:10.330089 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-79d2fb14-1a26-4464-873d-431ecbac0409 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:10.330564 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-79d2fb14-1a26-4464-873d-431ecbac0409 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:10.476426 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-79d2fb14-1a26-4464-873d-431ecbac0409 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:10.484146 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-79d2fb14-1a26-4464-873d-431ecbac0409 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1258 microversion: 2.1 time: 0.169814 Jun 17 11:46:10.484763 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 313/626] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:10 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1258 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:10.822679 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-efb36e73-235f-447c-bffb-970d5ae6f60d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:10.826508 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-efb36e73-235f-447c-bffb-970d5ae6f60d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:10.831699 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-efb36e73-235f-447c-bffb-970d5ae6f60d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:10.832498 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-efb36e73-235f-447c-bffb-970d5ae6f60d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:10.833547 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-efb36e73-235f-447c-bffb-970d5ae6f60d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:10.834214 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-efb36e73-235f-447c-bffb-970d5ae6f60d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:10.881682 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-efb36e73-235f-447c-bffb-970d5ae6f60d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Going to try to terminate instance {{(pid=124845) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 11:46:11.322631 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-efb36e73-235f-447c-bffb-970d5ae6f60d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "DELETE /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 204 len: 0 microversion: 2.1 time: 0.503938 Jun 17 11:46:11.323230 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 314/627] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 17 11:46:10 2022] DELETE /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 17 11:46:11.338147 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-0ba0250d-8be7-4ee0-8a27-c73adc2a06f2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:11.338758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-0ba0250d-8be7-4ee0-8a27-c73adc2a06f2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:11.346224 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0ba0250d-8be7-4ee0-8a27-c73adc2a06f2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:11.346672 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0ba0250d-8be7-4ee0-8a27-c73adc2a06f2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:11.347752 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0ba0250d-8be7-4ee0-8a27-c73adc2a06f2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:11.348185 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0ba0250d-8be7-4ee0-8a27-c73adc2a06f2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:11.503806 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a8549b24-7d6e-4159-976d-bd8c53102e31 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:11.504585 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a8549b24-7d6e-4159-976d-bd8c53102e31 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:11.511055 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a8549b24-7d6e-4159-976d-bd8c53102e31 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:11.511533 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a8549b24-7d6e-4159-976d-bd8c53102e31 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:11.512307 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a8549b24-7d6e-4159-976d-bd8c53102e31 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:11.512744 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a8549b24-7d6e-4159-976d-bd8c53102e31 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:11.540607 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-0ba0250d-8be7-4ee0-8a27-c73adc2a06f2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:11.549251 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-0ba0250d-8be7-4ee0-8a27-c73adc2a06f2 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1507 microversion: 2.1 time: 0.214872 Jun 17 11:46:11.549844 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 314/628] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:11 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1507 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:11.743899 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a8549b24-7d6e-4159-976d-bd8c53102e31 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:11.755323 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a8549b24-7d6e-4159-976d-bd8c53102e31 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1258 microversion: 2.1 time: 0.253255 Jun 17 11:46:11.755323 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 315/629] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:11 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1258 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:46:12.098954 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b6b58805-f5b6-48da-a2db-0a679c44997d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2047005232", "imageRef": "272eb2b7-ddf0-433f-8be8-cdc13c01be77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c868a535-9c12-4f90-862a-6c3a44470c58"}], "security_groups": [{"name": "tempest-securitygroup--1963854073"}], "key_name": "tempest-keypair-972361664", "user_data": "}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:46:12.212759 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.network.neutron [None req-b6b58805-f5b6-48da-a2db-0a679c44997d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] validate_networks() for [('c868a535-9c12-4f90-862a-6c3a44470c58', None, None, None, None, None)] {{(pid=124844) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 11:46:12.570030 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-7d0ac720-8c85-41b9-8778-9d513589c1b3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:12.571685 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-7d0ac720-8c85-41b9-8778-9d513589c1b3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:12.585430 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7d0ac720-8c85-41b9-8778-9d513589c1b3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:12.585793 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7d0ac720-8c85-41b9-8778-9d513589c1b3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:12.586597 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7d0ac720-8c85-41b9-8778-9d513589c1b3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:12.587035 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7d0ac720-8c85-41b9-8778-9d513589c1b3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:12.711030 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-b6b58805-f5b6-48da-a2db-0a679c44997d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Flavor limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 11:46:12.711582 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-b6b58805-f5b6-48da-a2db-0a679c44997d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Image limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 11:46:12.712113 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-b6b58805-f5b6-48da-a2db-0a679c44997d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Flavor pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 11:46:12.712522 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-b6b58805-f5b6-48da-a2db-0a679c44997d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Image pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 11:46:12.712986 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-b6b58805-f5b6-48da-a2db-0a679c44997d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 11:46:12.723229 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b6b58805-f5b6-48da-a2db-0a679c44997d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:12.723703 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b6b58805-f5b6-48da-a2db-0a679c44997d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:12.724510 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b6b58805-f5b6-48da-a2db-0a679c44997d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:12.724946 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b6b58805-f5b6-48da-a2db-0a679c44997d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:12.742315 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-b6b58805-f5b6-48da-a2db-0a679c44997d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Getting quotas for project b35e2c02ed78431fbbc93d3da1a7caba. Resources: {'instances', 'ram', 'cores'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 11:46:12.746839 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-b6b58805-f5b6-48da-a2db-0a679c44997d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Getting quotas for user f78027ac3a2c463fbe14da8443a09761 and project b35e2c02ed78431fbbc93d3da1a7caba. Resources: {'instances', 'ram', 'cores'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 11:46:12.759142 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b6b58805-f5b6-48da-a2db-0a679c44997d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Going to run 1 instances... {{(pid=124844) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 11:46:12.761814 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b6b58805-f5b6-48da-a2db-0a679c44997d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='272eb2b7-ddf0-433f-8be8-cdc13c01be77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 11:46:12.763738 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-7d0ac720-8c85-41b9-8778-9d513589c1b3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:12.772072 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-7d0ac720-8c85-41b9-8778-9d513589c1b3 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1507 microversion: 2.1 time: 0.205965 Jun 17 11:46:12.772762 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 316/630] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:12 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1507 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:12.778926 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-30334617-84ad-4184-a066-1629e7574ef5 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:12.779563 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-30334617-84ad-4184-a066-1629e7574ef5 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:12.787003 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-30334617-84ad-4184-a066-1629e7574ef5 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:12.787486 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-30334617-84ad-4184-a066-1629e7574ef5 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:12.788259 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-30334617-84ad-4184-a066-1629e7574ef5 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:12.788687 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-30334617-84ad-4184-a066-1629e7574ef5 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:12.935418 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-30334617-84ad-4184-a066-1629e7574ef5 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:12.944136 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-30334617-84ad-4184-a066-1629e7574ef5 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1258 microversion: 2.1 time: 0.168697 Jun 17 11:46:12.944742 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 317/631] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:12 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1258 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:12.962697 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b6b58805-f5b6-48da-a2db-0a679c44997d tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.868551 Jun 17 11:46:12.963483 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 315/632] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 17 11:46:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 11:46:12.974006 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9dc50445-4343-4430-ba40-3bfe2e07ea62 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:12.974704 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9dc50445-4343-4430-ba40-3bfe2e07ea62 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:13.036655 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9dc50445-4343-4430-ba40-3bfe2e07ea62 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:13.043598 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9dc50445-4343-4430-ba40-3bfe2e07ea62 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892" status: 200 len: 1237 microversion: 2.1 time: 0.073674 Jun 17 11:46:13.044549 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 318/633] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:12 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 => generated 1237 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:13.851210 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-135c21ee-ea40-4d56-a812-9675b0524e3e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:13.852082 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-135c21ee-ea40-4d56-a812-9675b0524e3e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:13.859337 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-135c21ee-ea40-4d56-a812-9675b0524e3e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:13.860429 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-135c21ee-ea40-4d56-a812-9675b0524e3e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:13.861204 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-135c21ee-ea40-4d56-a812-9675b0524e3e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:13.862159 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-135c21ee-ea40-4d56-a812-9675b0524e3e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:13.962270 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-d534d028-462d-493f-afe7-ea6be745066a tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:13.963706 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-d534d028-462d-493f-afe7-ea6be745066a tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:13.973675 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d534d028-462d-493f-afe7-ea6be745066a tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:13.974538 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d534d028-462d-493f-afe7-ea6be745066a tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:13.975633 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d534d028-462d-493f-afe7-ea6be745066a tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:13.976925 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d534d028-462d-493f-afe7-ea6be745066a tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:14.013016 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-135c21ee-ea40-4d56-a812-9675b0524e3e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:14.023059 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-135c21ee-ea40-4d56-a812-9675b0524e3e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1507 microversion: 2.1 time: 0.228904 Jun 17 11:46:14.024083 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 316/634] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:13 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1507 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:14.060999 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-7adbfe47-ae8a-45bb-9a8d-63440c3364db tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:14.061945 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7adbfe47-ae8a-45bb-9a8d-63440c3364db tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:14.134276 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7adbfe47-ae8a-45bb-9a8d-63440c3364db tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:14.145861 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-7adbfe47-ae8a-45bb-9a8d-63440c3364db tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892" status: 200 len: 1237 microversion: 2.1 time: 0.088515 Jun 17 11:46:14.154175 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 317/635] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:14 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 => generated 1237 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:46:14.166105 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-d534d028-462d-493f-afe7-ea6be745066a tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:14.174402 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-d534d028-462d-493f-afe7-ea6be745066a tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1258 microversion: 2.1 time: 0.216167 Jun 17 11:46:14.183808 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 319/636] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:13 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1258 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:46:14.557750 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-0cb24cf5-3e87-4814-9ebf-4a0728b8530c req-734d70e1-7495-4c6b-ac05-f951360056ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76c24c0d-60e5-45e5-afeb-d8595d5116f5", "name": "network-vif-deleted", "tag": "fbcdaa75-cd33-46e4-a7fd-57c88e44b5b6"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:46:14.567726 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-0cb24cf5-3e87-4814-9ebf-4a0728b8530c req-734d70e1-7495-4c6b-ac05-f951360056ef service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:14.568177 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-0cb24cf5-3e87-4814-9ebf-4a0728b8530c req-734d70e1-7495-4c6b-ac05-f951360056ef service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:14.582042 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-0cb24cf5-3e87-4814-9ebf-4a0728b8530c req-734d70e1-7495-4c6b-ac05-f951360056ef service nova] Creating event network-vif-deleted:fbcdaa75-cd33-46e4-a7fd-57c88e44b5b6 for instance 76c24c0d-60e5-45e5-afeb-d8595d5116f5 on hv-cinder-83716 Jun 17 11:46:14.595416 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-0cb24cf5-3e87-4814-9ebf-4a0728b8530c req-734d70e1-7495-4c6b-ac05-f951360056ef service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038375 Jun 17 11:46:14.596306 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 318/637] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:46:15.046130 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a4fa17f7-3dfd-49f5-8548-432afad7c583 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:15.048099 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a4fa17f7-3dfd-49f5-8548-432afad7c583 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:15.051676 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:46:15.061371 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a4fa17f7-3dfd-49f5-8548-432afad7c583 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:15.062331 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a4fa17f7-3dfd-49f5-8548-432afad7c583 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:15.063804 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a4fa17f7-3dfd-49f5-8548-432afad7c583 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:15.064635 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a4fa17f7-3dfd-49f5-8548-432afad7c583 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:15.120272 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a4fa17f7-3dfd-49f5-8548-432afad7c583 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:15.120723 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a4fa17f7-3dfd-49f5-8548-432afad7c583 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:15.121178 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-a4fa17f7-3dfd-49f5-8548-432afad7c583 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lazy-loading 'fault' on Instance uuid 76c24c0d-60e5-45e5-afeb-d8595d5116f5 {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:46:15.164230 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-09cd2ac5-c759-4cae-816e-b3d11e350b7b tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:15.164936 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-09cd2ac5-c759-4cae-816e-b3d11e350b7b tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:15.167527 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a4fa17f7-3dfd-49f5-8548-432afad7c583 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:15.172112 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-09cd2ac5-c759-4cae-816e-b3d11e350b7b tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:15.173269 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-09cd2ac5-c759-4cae-816e-b3d11e350b7b tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:15.174574 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-09cd2ac5-c759-4cae-816e-b3d11e350b7b tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:15.175029 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-09cd2ac5-c759-4cae-816e-b3d11e350b7b tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:15.176698 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a4fa17f7-3dfd-49f5-8548-432afad7c583 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1311 microversion: 2.1 time: 0.138130 Jun 17 11:46:15.177587 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 320/638] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:15 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1311 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:15.195088 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4536e8ad-9b14-4137-a459-1be63c87290f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:15.195734 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4536e8ad-9b14-4137-a459-1be63c87290f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:15.202272 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4536e8ad-9b14-4137-a459-1be63c87290f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:15.202989 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4536e8ad-9b14-4137-a459-1be63c87290f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:15.204756 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4536e8ad-9b14-4137-a459-1be63c87290f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:15.205190 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4536e8ad-9b14-4137-a459-1be63c87290f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:15.248034 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-09cd2ac5-c759-4cae-816e-b3d11e350b7b tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:15.261718 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-09cd2ac5-c759-4cae-816e-b3d11e350b7b tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892" status: 200 len: 1241 microversion: 2.1 time: 0.101725 Jun 17 11:46:15.262815 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 319/639] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:15 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 => generated 1241 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:46:15.401294 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-4536e8ad-9b14-4137-a459-1be63c87290f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:15.411403 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4536e8ad-9b14-4137-a459-1be63c87290f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1258 microversion: 2.1 time: 0.220456 Jun 17 11:46:15.418697 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 321/640] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:15 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1258 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:16.203322 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-0677284c-aa2a-46be-8be9-699dcd760f58 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:16.204545 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-0677284c-aa2a-46be-8be9-699dcd760f58 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:16.224346 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0677284c-aa2a-46be-8be9-699dcd760f58 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:16.224346 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0677284c-aa2a-46be-8be9-699dcd760f58 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:16.224346 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0677284c-aa2a-46be-8be9-699dcd760f58 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:16.224346 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0677284c-aa2a-46be-8be9-699dcd760f58 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:16.254656 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0677284c-aa2a-46be-8be9-699dcd760f58 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:16.255099 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0677284c-aa2a-46be-8be9-699dcd760f58 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:16.259930 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-0677284c-aa2a-46be-8be9-699dcd760f58 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lazy-loading 'fault' on Instance uuid 76c24c0d-60e5-45e5-afeb-d8595d5116f5 {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:46:16.282916 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a6c6bce6-c1a5-42ef-aa34-4669166fba55 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:16.283639 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a6c6bce6-c1a5-42ef-aa34-4669166fba55 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:16.291423 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a6c6bce6-c1a5-42ef-aa34-4669166fba55 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:16.291884 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a6c6bce6-c1a5-42ef-aa34-4669166fba55 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:16.292665 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a6c6bce6-c1a5-42ef-aa34-4669166fba55 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:16.293135 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a6c6bce6-c1a5-42ef-aa34-4669166fba55 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:16.296902 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-0677284c-aa2a-46be-8be9-699dcd760f58 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:16.304697 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-0677284c-aa2a-46be-8be9-699dcd760f58 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 200 len: 1311 microversion: 2.1 time: 0.105305 Jun 17 11:46:16.305570 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 320/641] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:16 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 1311 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:16.358582 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a6c6bce6-c1a5-42ef-aa34-4669166fba55 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:16.367061 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a6c6bce6-c1a5-42ef-aa34-4669166fba55 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892" status: 200 len: 1289 microversion: 2.1 time: 0.088883 Jun 17 11:46:16.367658 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 322/642] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:16 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 => generated 1289 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:46:16.429700 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-7c2c8e98-a4aa-4cd8-846d-5b1ac2621da3 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:16.430306 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7c2c8e98-a4aa-4cd8-846d-5b1ac2621da3 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:16.436398 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7c2c8e98-a4aa-4cd8-846d-5b1ac2621da3 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:16.441478 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7c2c8e98-a4aa-4cd8-846d-5b1ac2621da3 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:16.441478 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7c2c8e98-a4aa-4cd8-846d-5b1ac2621da3 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:16.441478 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7c2c8e98-a4aa-4cd8-846d-5b1ac2621da3 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:16.591301 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7c2c8e98-a4aa-4cd8-846d-5b1ac2621da3 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:16.599625 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-7c2c8e98-a4aa-4cd8-846d-5b1ac2621da3 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1258 microversion: 2.1 time: 0.173802 Jun 17 11:46:16.600510 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 321/643] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:16 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1258 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:17.156264 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-df2ef3b0-4c6d-4a40-a392-977529a01eb5 req-960b9ace-1e0f-4006-a367-0081cba68228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef2e4aca-bc09-41dd-9f63-3a8649cf871c", "name": "network-vif-plugged", "status": "completed", "tag": "0b44766a-48d1-49bc-a348-b25e0252287f"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:46:17.167398 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-df2ef3b0-4c6d-4a40-a392-977529a01eb5 req-960b9ace-1e0f-4006-a367-0081cba68228 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:17.167991 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-df2ef3b0-4c6d-4a40-a392-977529a01eb5 req-960b9ace-1e0f-4006-a367-0081cba68228 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:17.180201 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-df2ef3b0-4c6d-4a40-a392-977529a01eb5 req-960b9ace-1e0f-4006-a367-0081cba68228 service nova] Creating event network-vif-plugged:0b44766a-48d1-49bc-a348-b25e0252287f for instance ef2e4aca-bc09-41dd-9f63-3a8649cf871c on hv-cinder-83716 Jun 17 11:46:17.191166 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-df2ef3b0-4c6d-4a40-a392-977529a01eb5 req-960b9ace-1e0f-4006-a367-0081cba68228 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037099 Jun 17 11:46:17.191166 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 323/644] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:46:17.326549 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e3d842c8-1e9d-433c-b96b-f4dc8373513d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:17.327891 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e3d842c8-1e9d-433c-b96b-f4dc8373513d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 76c24c0d-60e5-45e5-afeb-d8595d5116f5] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:17.343508 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e3d842c8-1e9d-433c-b96b-f4dc8373513d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:17.345378 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e3d842c8-1e9d-433c-b96b-f4dc8373513d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:17.347485 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e3d842c8-1e9d-433c-b96b-f4dc8373513d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:17.348971 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e3d842c8-1e9d-433c-b96b-f4dc8373513d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:17.379021 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-e3d842c8-1e9d-433c-b96b-f4dc8373513d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] HTTP exception thrown: Instance 76c24c0d-60e5-45e5-afeb-d8595d5116f5 could not be found. Jun 17 11:46:17.382815 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e3d842c8-1e9d-433c-b96b-f4dc8373513d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Request method failure captured: Jun 17 11:46:17.382815 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: request: GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 HTTP/1.1 Jun 17 11:46:17.382815 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept: application/json Jun 17 11:46:17.382815 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jun 17 11:46:17.382815 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Connection: close Jun 17 11:46:17.382815 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jun 17 11:46:17.382815 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jun 17 11:46:17.382815 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Host: 10.222.0.45 Jun 17 11:46:17.382815 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jun 17 11:46:17.382815 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jun 17 11:46:17.382815 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABirGhYXPEneGbWlDHr4IdGyKcI2lSvyu7_ndCScBUrORne39u-qQqZEMZQFH6SJDovDOcnVKjNuoxzr715SnSXgShkw-ZY_5pruDdyzsw0BrOMIBFmyx6bizWQou_OUbd6ovLhc1PtNOl8-D1aQsyvMYXlGV0IY28idRqZ__sES5ASbXg Jun 17 11:46:17.382815 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jun 17 11:46:17.382815 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jun 17 11:46:17.382815 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jun 17 11:46:17.382815 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jun 17 11:46:17.382815 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jun 17 11:46:17.382815 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jun 17 11:46:17.382815 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Id: e38262ed2ed84004a6e01d423cadcae4 Jun 17 11:46:17.382815 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1413190309 Jun 17 11:46:17.382815 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Role: member,reader Jun 17 11:46:17.382815 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Roles: member,reader Jun 17 11:46:17.385745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e38262ed2ed84004a6e01d423cadcae4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e38262ed2ed84004a6e01d423cadcae4", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e38262ed2ed84004a6e01d423cadcae4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e38262ed2ed84004a6e01d423cadcae4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:46:17.385745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1413190309 Jun 17 11:46:17.385745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Id: e38262ed2ed84004a6e01d423cadcae4 Jun 17 11:46:17.385745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1413190309 Jun 17 11:46:17.385745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User: tempest-ServerRescueNegativeTestJSON-1413190309-project Jun 17 11:46:17.385745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jun 17 11:46:17.385745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jun 17 11:46:17.385745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Id: a79957b3f2e94f31bd2cb82290ed0962 Jun 17 11:46:17.385745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1413190309-project Jun 17 11:46:17.385745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: method: > Jun 17 11:46:17.385745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: exception: Instance 76c24c0d-60e5-45e5-afeb-d8595d5116f5 could not be found. Jun 17 11:46:17.385745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: action_args: {'id': '76c24c0d-60e5-45e5-afeb-d8595d5116f5'} Jun 17 11:46:17.387487 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:46:17.387487 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:46:17.387487 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:46:17.387487 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:46:17.387487 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:46:17.387487 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:46:17.387487 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:46:17.387487 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:46:17.387487 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:46:17.387487 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:46:17.387487 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76c24c0d-60e5-45e5-afeb-d8595d5116f5 could not be found. Jun 17 11:46:17.387487 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:46:17.387487 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:46:17.387487 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:46:17.387487 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:46:17.387487 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:46:17.387487 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:46:17.387487 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:46:17.387487 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:46:17.387487 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:46:17.390273 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:46:17.390273 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 11:46:17.390273 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 11:46:17.390273 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:46:17.390273 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:46:17.390273 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:46:17.390273 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:46:17.390273 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76c24c0d-60e5-45e5-afeb-d8595d5116f5 could not be found. Jun 17 11:46:17.390273 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:46:17.390273 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:46:17.390273 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:46:17.390273 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:46:17.390273 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:46:17.390273 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:46:17.390273 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:46:17.390273 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:46:17.390273 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76c24c0d-60e5-45e5-afeb-d8595d5116f5 could not be found. Jun 17 11:46:17.390273 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:46:17.394768 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e3d842c8-1e9d-433c-b96b-f4dc8373513d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Returning 404 to user: Instance 76c24c0d-60e5-45e5-afeb-d8595d5116f5 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:46:17.396546 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e3d842c8-1e9d-433c-b96b-f4dc8373513d tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5" status: 404 len: 111 microversion: 2.1 time: 0.076061 Jun 17 11:46:17.397747 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 322/645] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:17 2022] GET /compute/v2.1/servers/76c24c0d-60e5-45e5-afeb-d8595d5116f5 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:46:17.405370 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9154b19d-5410-4431-b5e1-9477ae5de012 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:17.405370 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9154b19d-5410-4431-b5e1-9477ae5de012 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:17.413474 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a3a3553f-7218-4dc5-b759-e1e5b57cf7b9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:17.415495 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a3a3553f-7218-4dc5-b759-e1e5b57cf7b9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:17.426125 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9154b19d-5410-4431-b5e1-9477ae5de012 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:17.426695 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9154b19d-5410-4431-b5e1-9477ae5de012 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:17.427797 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9154b19d-5410-4431-b5e1-9477ae5de012 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:17.429382 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a3a3553f-7218-4dc5-b759-e1e5b57cf7b9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:17.430078 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9154b19d-5410-4431-b5e1-9477ae5de012 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:17.430668 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a3a3553f-7218-4dc5-b759-e1e5b57cf7b9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:17.432100 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a3a3553f-7218-4dc5-b759-e1e5b57cf7b9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:17.433154 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a3a3553f-7218-4dc5-b759-e1e5b57cf7b9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:17.487594 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a3a3553f-7218-4dc5-b759-e1e5b57cf7b9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Going to try to terminate instance {{(pid=124844) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 11:46:17.515118 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9154b19d-5410-4431-b5e1-9477ae5de012 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:17.525683 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9154b19d-5410-4431-b5e1-9477ae5de012 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892" status: 200 len: 1295 microversion: 2.1 time: 0.142983 Jun 17 11:46:17.526332 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 324/646] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:17 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 => generated 1295 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:17.555347 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-976e8b48-6fdc-4f72-8ced-011f12188490 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:17.555902 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-976e8b48-6fdc-4f72-8ced-011f12188490 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:17.564291 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-976e8b48-6fdc-4f72-8ced-011f12188490 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:17.565066 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-976e8b48-6fdc-4f72-8ced-011f12188490 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:17.566625 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-976e8b48-6fdc-4f72-8ced-011f12188490 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:17.567459 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-976e8b48-6fdc-4f72-8ced-011f12188490 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:17.597381 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:46:17.660116 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:46:17.740896 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-976e8b48-6fdc-4f72-8ced-011f12188490 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:17.754990 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-976e8b48-6fdc-4f72-8ced-011f12188490 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1592 microversion: 2.1 time: 0.203484 Jun 17 11:46:17.755639 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 325/647] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:17 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1592 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:17.760640 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-aefd7896-f418-46e3-8128-6bd7add7ab00 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:17.761513 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-aefd7896-f418-46e3-8128-6bd7add7ab00 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:17.772644 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-aefd7896-f418-46e3-8128-6bd7add7ab00 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:17.776834 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-aefd7896-f418-46e3-8128-6bd7add7ab00 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:17.780010 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-aefd7896-f418-46e3-8128-6bd7add7ab00 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:17.780520 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-aefd7896-f418-46e3-8128-6bd7add7ab00 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:17.867611 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a3a3553f-7218-4dc5-b759-e1e5b57cf7b9 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "DELETE /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74" status: 204 len: 0 microversion: 2.1 time: 0.464056 Jun 17 11:46:17.869949 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 323/648] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 17 11:46:17 2022] DELETE /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 11:46:17.884204 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e78c87c2-5157-42b2-9998-879e9913adee tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:17.887007 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e78c87c2-5157-42b2-9998-879e9913adee tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:17.898180 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e78c87c2-5157-42b2-9998-879e9913adee tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:17.899205 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e78c87c2-5157-42b2-9998-879e9913adee tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:17.901962 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e78c87c2-5157-42b2-9998-879e9913adee tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:17.902703 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e78c87c2-5157-42b2-9998-879e9913adee tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:18.030603 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-aefd7896-f418-46e3-8128-6bd7add7ab00 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:18.037343 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-aefd7896-f418-46e3-8128-6bd7add7ab00 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1258 microversion: 2.1 time: 0.280249 Jun 17 11:46:18.038150 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 326/649] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:17 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1258 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:18.104814 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e78c87c2-5157-42b2-9998-879e9913adee tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:18.114193 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e78c87c2-5157-42b2-9998-879e9913adee tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74" status: 200 len: 1522 microversion: 2.1 time: 0.239543 Jun 17 11:46:18.114789 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 324/650] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:17 2022] GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:18.546770 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b887c90c-5965-4f16-ab4f-487481b45998 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:18.548648 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b887c90c-5965-4f16-ab4f-487481b45998 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:18.555933 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b887c90c-5965-4f16-ab4f-487481b45998 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:18.556373 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b887c90c-5965-4f16-ab4f-487481b45998 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:18.557140 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b887c90c-5965-4f16-ab4f-487481b45998 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:18.557567 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b887c90c-5965-4f16-ab4f-487481b45998 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:18.704837 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b887c90c-5965-4f16-ab4f-487481b45998 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:18.712977 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b887c90c-5965-4f16-ab4f-487481b45998 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892" status: 200 len: 1363 microversion: 2.1 time: 0.170849 Jun 17 11:46:18.713701 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 327/651] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:18 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:19.054903 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-22dc01a2-2412-4574-b635-415d0b79d25e tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:19.055708 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-22dc01a2-2412-4574-b635-415d0b79d25e tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:19.062606 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-22dc01a2-2412-4574-b635-415d0b79d25e tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:19.064039 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-22dc01a2-2412-4574-b635-415d0b79d25e tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:19.064559 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-22dc01a2-2412-4574-b635-415d0b79d25e tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:19.064996 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-22dc01a2-2412-4574-b635-415d0b79d25e tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:19.133959 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-aa0e757b-bbfe-4dea-bb49-041ddd8384ca tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:19.134685 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-aa0e757b-bbfe-4dea-bb49-041ddd8384ca tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:19.143477 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-aa0e757b-bbfe-4dea-bb49-041ddd8384ca tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:19.144170 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-aa0e757b-bbfe-4dea-bb49-041ddd8384ca tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:19.145310 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-aa0e757b-bbfe-4dea-bb49-041ddd8384ca tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:19.146309 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-aa0e757b-bbfe-4dea-bb49-041ddd8384ca tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:19.258132 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-22dc01a2-2412-4574-b635-415d0b79d25e tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:19.274014 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-22dc01a2-2412-4574-b635-415d0b79d25e tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1258 microversion: 2.1 time: 0.223208 Jun 17 11:46:19.275132 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 325/652] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:19 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1258 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:19.352320 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-aa0e757b-bbfe-4dea-bb49-041ddd8384ca tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:19.361201 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-aa0e757b-bbfe-4dea-bb49-041ddd8384ca tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74" status: 200 len: 1522 microversion: 2.1 time: 0.232452 Jun 17 11:46:19.361870 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 328/653] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:19 2022] GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:19.736139 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a00d8c4c-e8de-4ffb-af64-fd4a5b3ba517 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:19.736781 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a00d8c4c-e8de-4ffb-af64-fd4a5b3ba517 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:19.743212 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a00d8c4c-e8de-4ffb-af64-fd4a5b3ba517 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:19.743698 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a00d8c4c-e8de-4ffb-af64-fd4a5b3ba517 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:19.744509 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a00d8c4c-e8de-4ffb-af64-fd4a5b3ba517 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:19.744990 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a00d8c4c-e8de-4ffb-af64-fd4a5b3ba517 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:19.904620 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a00d8c4c-e8de-4ffb-af64-fd4a5b3ba517 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:19.913151 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a00d8c4c-e8de-4ffb-af64-fd4a5b3ba517 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892" status: 200 len: 1363 microversion: 2.1 time: 0.184281 Jun 17 11:46:19.913731 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 326/654] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:19 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:20.294548 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8bd46fe1-e447-48d8-9459-cde475c3af05 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:20.295193 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-8bd46fe1-e447-48d8-9459-cde475c3af05 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:20.303319 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8bd46fe1-e447-48d8-9459-cde475c3af05 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:20.303849 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8bd46fe1-e447-48d8-9459-cde475c3af05 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:20.304647 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8bd46fe1-e447-48d8-9459-cde475c3af05 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:20.305081 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8bd46fe1-e447-48d8-9459-cde475c3af05 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:20.337506 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-4f075a9b-aba4-47fa-abe1-fe564eb92c31 req-e94ee88b-3bbd-4899-8c78-f62b0eb7d87e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907", "tag": "f866082a-76d6-466b-8c49-7a5068d4d87f"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:46:20.347338 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-4f075a9b-aba4-47fa-abe1-fe564eb92c31 req-e94ee88b-3bbd-4899-8c78-f62b0eb7d87e service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:20.347932 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-4f075a9b-aba4-47fa-abe1-fe564eb92c31 req-e94ee88b-3bbd-4899-8c78-f62b0eb7d87e service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:20.360649 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-4f075a9b-aba4-47fa-abe1-fe564eb92c31 req-e94ee88b-3bbd-4899-8c78-f62b0eb7d87e service nova] Creating event network-changed:f866082a-76d6-466b-8c49-7a5068d4d87f for instance 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 on hv-cinder-83716 Jun 17 11:46:20.366012 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-4f075a9b-aba4-47fa-abe1-fe564eb92c31 req-e94ee88b-3bbd-4899-8c78-f62b0eb7d87e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038899 Jun 17 11:46:20.366791 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 327/655] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:46:20.379565 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2b9da5c2-654d-4152-80c6-ef9516e4e51b tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:20.380527 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-2b9da5c2-654d-4152-80c6-ef9516e4e51b tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:20.392355 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2b9da5c2-654d-4152-80c6-ef9516e4e51b tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:20.392355 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2b9da5c2-654d-4152-80c6-ef9516e4e51b tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:20.392355 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2b9da5c2-654d-4152-80c6-ef9516e4e51b tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:20.392355 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2b9da5c2-654d-4152-80c6-ef9516e4e51b tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:20.548753 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-8bd46fe1-e447-48d8-9459-cde475c3af05 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:20.556717 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-8bd46fe1-e447-48d8-9459-cde475c3af05 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1258 microversion: 2.1 time: 0.266391 Jun 17 11:46:20.557673 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 329/656] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:20 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1258 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:20.628675 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2b9da5c2-654d-4152-80c6-ef9516e4e51b tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:20.638792 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2b9da5c2-654d-4152-80c6-ef9516e4e51b tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74" status: 200 len: 1522 microversion: 2.1 time: 0.264017 Jun 17 11:46:20.639976 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 328/657] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:20 2022] GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:46:20.932463 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b1f48040-9e45-4b5b-ae09-ac25a15b73a6 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:20.933260 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b1f48040-9e45-4b5b-ae09-ac25a15b73a6 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:20.939797 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b1f48040-9e45-4b5b-ae09-ac25a15b73a6 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:20.940353 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b1f48040-9e45-4b5b-ae09-ac25a15b73a6 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:20.941237 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b1f48040-9e45-4b5b-ae09-ac25a15b73a6 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:20.941838 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b1f48040-9e45-4b5b-ae09-ac25a15b73a6 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:21.144529 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b1f48040-9e45-4b5b-ae09-ac25a15b73a6 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:21.153186 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b1f48040-9e45-4b5b-ae09-ac25a15b73a6 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892" status: 200 len: 1363 microversion: 2.1 time: 0.225945 Jun 17 11:46:21.153800 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 330/658] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:20 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:21.583117 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1d7d6302-c423-4c36-ba12-f41d1520a15b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:21.583778 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-1d7d6302-c423-4c36-ba12-f41d1520a15b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:21.597504 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1d7d6302-c423-4c36-ba12-f41d1520a15b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:21.597504 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1d7d6302-c423-4c36-ba12-f41d1520a15b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:21.597504 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1d7d6302-c423-4c36-ba12-f41d1520a15b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:21.597504 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1d7d6302-c423-4c36-ba12-f41d1520a15b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:21.656973 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-cbfa80cd-00d9-4895-ab46-e65b8f46c4d1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:21.658222 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-cbfa80cd-00d9-4895-ab46-e65b8f46c4d1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:21.666409 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cbfa80cd-00d9-4895-ab46-e65b8f46c4d1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:21.667201 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cbfa80cd-00d9-4895-ab46-e65b8f46c4d1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:21.668239 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cbfa80cd-00d9-4895-ab46-e65b8f46c4d1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:21.670133 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cbfa80cd-00d9-4895-ab46-e65b8f46c4d1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:21.886031 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-1d7d6302-c423-4c36-ba12-f41d1520a15b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:21.896461 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-1d7d6302-c423-4c36-ba12-f41d1520a15b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1258 microversion: 2.1 time: 0.318355 Jun 17 11:46:21.897737 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 329/659] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:21 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1258 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:21.912619 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-cbfa80cd-00d9-4895-ab46-e65b8f46c4d1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:21.922170 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-cbfa80cd-00d9-4895-ab46-e65b8f46c4d1 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74" status: 200 len: 1522 microversion: 2.1 time: 0.269486 Jun 17 11:46:21.923011 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 331/660] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:21 2022] GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:46:22.174132 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e6e86daa-637e-4da0-b216-564c1f289e20 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:22.175194 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e6e86daa-637e-4da0-b216-564c1f289e20 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:22.185529 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e6e86daa-637e-4da0-b216-564c1f289e20 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:22.185529 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e6e86daa-637e-4da0-b216-564c1f289e20 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:22.189404 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e6e86daa-637e-4da0-b216-564c1f289e20 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:22.189988 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e6e86daa-637e-4da0-b216-564c1f289e20 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:22.555032 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e6e86daa-637e-4da0-b216-564c1f289e20 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:22.568970 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e6e86daa-637e-4da0-b216-564c1f289e20 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892" status: 200 len: 1363 microversion: 2.1 time: 0.400075 Jun 17 11:46:22.579233 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 330/661] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:22 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 => generated 1363 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:22.657557 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-61d7e3b3-0699-4f56-b998-4282ccb96489 req-ae676cad-216d-46f7-86f0-f3d31c37b72c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ed47de2-4bfc-4635-8345-47b1cc369892", "tag": "4272e231-ff05-439d-a324-ff813464d4bb"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:46:22.677752 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-61d7e3b3-0699-4f56-b998-4282ccb96489 req-ae676cad-216d-46f7-86f0-f3d31c37b72c service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:22.678444 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-61d7e3b3-0699-4f56-b998-4282ccb96489 req-ae676cad-216d-46f7-86f0-f3d31c37b72c service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:22.691283 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-61d7e3b3-0699-4f56-b998-4282ccb96489 req-ae676cad-216d-46f7-86f0-f3d31c37b72c service nova] Creating event network-changed:4272e231-ff05-439d-a324-ff813464d4bb for instance 2ed47de2-4bfc-4635-8345-47b1cc369892 on hv-cinder-83716 Jun 17 11:46:22.696781 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-61d7e3b3-0699-4f56-b998-4282ccb96489 req-ae676cad-216d-46f7-86f0-f3d31c37b72c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043309 Jun 17 11:46:22.697976 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 332/662] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:46:22.918051 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-cb42a4e7-d04a-4eee-a37b-889f1d41b522 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:22.919211 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-cb42a4e7-d04a-4eee-a37b-889f1d41b522 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:22.930647 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=2 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:46:22.935078 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cb42a4e7-d04a-4eee-a37b-889f1d41b522 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:22.937206 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cb42a4e7-d04a-4eee-a37b-889f1d41b522 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:22.939621 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cb42a4e7-d04a-4eee-a37b-889f1d41b522 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:22.940306 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cb42a4e7-d04a-4eee-a37b-889f1d41b522 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:22.941070 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-769229e5-cde7-4c23-a313-ade3fb8862d7 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:22.941785 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-769229e5-cde7-4c23-a313-ade3fb8862d7 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:22.964998 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-769229e5-cde7-4c23-a313-ade3fb8862d7 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:22.968378 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-769229e5-cde7-4c23-a313-ade3fb8862d7 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:22.970036 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-769229e5-cde7-4c23-a313-ade3fb8862d7 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:22.970495 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-769229e5-cde7-4c23-a313-ade3fb8862d7 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:23.047975 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:46:23.130955 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-769229e5-cde7-4c23-a313-ade3fb8862d7 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:23.142229 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-769229e5-cde7-4c23-a313-ade3fb8862d7 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74" status: 200 len: 1480 microversion: 2.1 time: 0.205905 Jun 17 11:46:23.143848 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 333/663] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:22 2022] GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74 => generated 1480 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:23.287721 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-c33e2bee-30a1-4a3a-83b4-1a79d7dc045f req-66d4b6cf-6efe-42c6-a769-9949aa718ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39a1319f-9f84-46db-9981-30ff7e4acc74", "name": "network-vif-deleted", "tag": "845a8d6f-82d9-4eca-a43c-35be0c12da3d"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:46:23.303114 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-c33e2bee-30a1-4a3a-83b4-1a79d7dc045f req-66d4b6cf-6efe-42c6-a769-9949aa718ca4 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:23.304596 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-c33e2bee-30a1-4a3a-83b4-1a79d7dc045f req-66d4b6cf-6efe-42c6-a769-9949aa718ca4 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:23.334728 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-c33e2bee-30a1-4a3a-83b4-1a79d7dc045f req-66d4b6cf-6efe-42c6-a769-9949aa718ca4 service nova] Creating event network-vif-deleted:845a8d6f-82d9-4eca-a43c-35be0c12da3d for instance 39a1319f-9f84-46db-9981-30ff7e4acc74 on hv-cinder-83716 Jun 17 11:46:23.347111 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-c33e2bee-30a1-4a3a-83b4-1a79d7dc045f req-66d4b6cf-6efe-42c6-a769-9949aa718ca4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064507 Jun 17 11:46:23.348245 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 334/664] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:46:23.590645 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-3e275a38-6be9-4c51-a801-74dcbc603adc tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:23.592135 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-3e275a38-6be9-4c51-a801-74dcbc603adc tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:23.602616 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3e275a38-6be9-4c51-a801-74dcbc603adc tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:23.605001 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3e275a38-6be9-4c51-a801-74dcbc603adc tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:23.605001 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3e275a38-6be9-4c51-a801-74dcbc603adc tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:23.605355 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3e275a38-6be9-4c51-a801-74dcbc603adc tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:23.704793 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-cb42a4e7-d04a-4eee-a37b-889f1d41b522 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:23.724004 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-cb42a4e7-d04a-4eee-a37b-889f1d41b522 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1258 microversion: 2.1 time: 0.813393 Jun 17 11:46:23.724846 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 331/665] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:22 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1258 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:23.916412 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-3e275a38-6be9-4c51-a801-74dcbc603adc tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:23.928863 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-3e275a38-6be9-4c51-a801-74dcbc603adc tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892" status: 200 len: 1363 microversion: 2.1 time: 0.345395 Jun 17 11:46:23.929885 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 335/666] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:23 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 => generated 1363 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:24.187445 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5f356c94-fcf9-40d1-bb0c-4a1fc3c5688e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:24.187445 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-5f356c94-fcf9-40d1-bb0c-4a1fc3c5688e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:24.187445 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=12 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:46:24.187445 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5f356c94-fcf9-40d1-bb0c-4a1fc3c5688e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:24.189375 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5f356c94-fcf9-40d1-bb0c-4a1fc3c5688e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:24.189375 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5f356c94-fcf9-40d1-bb0c-4a1fc3c5688e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:24.189375 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5f356c94-fcf9-40d1-bb0c-4a1fc3c5688e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:24.225194 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5f356c94-fcf9-40d1-bb0c-4a1fc3c5688e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:24.225647 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5f356c94-fcf9-40d1-bb0c-4a1fc3c5688e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:24.226125 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-5f356c94-fcf9-40d1-bb0c-4a1fc3c5688e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lazy-loading 'fault' on Instance uuid 39a1319f-9f84-46db-9981-30ff7e4acc74 {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:46:24.269161 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5f356c94-fcf9-40d1-bb0c-4a1fc3c5688e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:24.277140 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5f356c94-fcf9-40d1-bb0c-4a1fc3c5688e tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74" status: 200 len: 1311 microversion: 2.1 time: 0.118282 Jun 17 11:46:24.277768 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 332/667] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:24 2022] GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74 => generated 1311 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:24.744981 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9d42223f-a160-4333-9a81-1c55d9225240 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:24.745971 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9d42223f-a160-4333-9a81-1c55d9225240 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:24.753995 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9d42223f-a160-4333-9a81-1c55d9225240 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:24.754463 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9d42223f-a160-4333-9a81-1c55d9225240 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:24.755223 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9d42223f-a160-4333-9a81-1c55d9225240 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:24.755691 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9d42223f-a160-4333-9a81-1c55d9225240 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:24.914725 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9d42223f-a160-4333-9a81-1c55d9225240 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:24.922643 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5637ddf1-84f7-41fb-b63c-76ff4cde46a9 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1887351586"}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:46:24.923413 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-5637ddf1-84f7-41fb-b63c-76ff4cde46a9 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:24.928190 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9d42223f-a160-4333-9a81-1c55d9225240 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1442 microversion: 2.1 time: 0.189466 Jun 17 11:46:24.930434 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5637ddf1-84f7-41fb-b63c-76ff4cde46a9 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:24.930963 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5637ddf1-84f7-41fb-b63c-76ff4cde46a9 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:24.931861 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5637ddf1-84f7-41fb-b63c-76ff4cde46a9 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:24.932383 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5637ddf1-84f7-41fb-b63c-76ff4cde46a9 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:24.941041 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 336/668] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:24 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1442 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:24.948015 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-d3aaeb98-d1c3-4bcd-841d-715bed2b2cd1 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:24.948683 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-d3aaeb98-d1c3-4bcd-841d-715bed2b2cd1 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:24.956258 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d3aaeb98-d1c3-4bcd-841d-715bed2b2cd1 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:24.967187 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d3aaeb98-d1c3-4bcd-841d-715bed2b2cd1 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:24.967187 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d3aaeb98-d1c3-4bcd-841d-715bed2b2cd1 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:24.967187 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d3aaeb98-d1c3-4bcd-841d-715bed2b2cd1 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:25.137290 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.network.security_group_api [None req-5637ddf1-84f7-41fb-b63c-76ff4cde46a9 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Adding security group 8d91bc0d-447a-4a42-893d-4ee42b359dc9 to port f866082a-76d6-466b-8c49-7a5068d4d87f Jun 17 11:46:25.201783 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-d3aaeb98-d1c3-4bcd-841d-715bed2b2cd1 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:25.210618 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-d3aaeb98-d1c3-4bcd-841d-715bed2b2cd1 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892" status: 200 len: 1363 microversion: 2.1 time: 0.266825 Jun 17 11:46:25.211291 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 337/669] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:24 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 => generated 1363 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:25.220522 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9d500308-7ada-4c1f-b044-b03f19d2d8a1 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:25.222179 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9d500308-7ada-4c1f-b044-b03f19d2d8a1 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:25.233392 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9d500308-7ada-4c1f-b044-b03f19d2d8a1 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:25.234296 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9d500308-7ada-4c1f-b044-b03f19d2d8a1 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:25.235878 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9d500308-7ada-4c1f-b044-b03f19d2d8a1 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:25.236743 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9d500308-7ada-4c1f-b044-b03f19d2d8a1 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:25.480990 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9d500308-7ada-4c1f-b044-b03f19d2d8a1 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:25.489672 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9d500308-7ada-4c1f-b044-b03f19d2d8a1 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1442 microversion: 2.1 time: 0.277371 Jun 17 11:46:25.490622 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 338/670] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:25 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1442 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:25.495594 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b45f1fcc-3cf1-4e99-bf87-9ae19ea80847 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:25.496532 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b45f1fcc-3cf1-4e99-bf87-9ae19ea80847 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:25.504144 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b45f1fcc-3cf1-4e99-bf87-9ae19ea80847 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:25.504635 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b45f1fcc-3cf1-4e99-bf87-9ae19ea80847 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:25.505440 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b45f1fcc-3cf1-4e99-bf87-9ae19ea80847 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:25.505879 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b45f1fcc-3cf1-4e99-bf87-9ae19ea80847 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:25.562026 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b45f1fcc-3cf1-4e99-bf87-9ae19ea80847 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:25.562536 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b45f1fcc-3cf1-4e99-bf87-9ae19ea80847 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:25.564453 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-b45f1fcc-3cf1-4e99-bf87-9ae19ea80847 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lazy-loading 'fault' on Instance uuid 39a1319f-9f84-46db-9981-30ff7e4acc74 {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:46:25.630209 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b45f1fcc-3cf1-4e99-bf87-9ae19ea80847 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79957b3f2e94f31bd2cb82290ed0962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38262ed2ed84004a6e01d423cadcae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:25.646112 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b45f1fcc-3cf1-4e99-bf87-9ae19ea80847 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74" status: 200 len: 1311 microversion: 2.1 time: 0.153915 Jun 17 11:46:25.647241 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 339/671] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:25 2022] GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74 => generated 1311 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:25.873551 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5637ddf1-84f7-41fb-b63c-76ff4cde46a9 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "POST /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/action" status: 202 len: 0 microversion: 2.1 time: 0.954970 Jun 17 11:46:25.881717 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 333/672] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jun 17 11:46:24 2022] POST /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/action => generated 0 bytes in 959 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 17 11:46:25.888232 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-77dbb8b5-90aa-4270-a381-949bcd7165dc tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:25.889571 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-77dbb8b5-90aa-4270-a381-949bcd7165dc tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:25.911621 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-77dbb8b5-90aa-4270-a381-949bcd7165dc tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:25.913786 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-77dbb8b5-90aa-4270-a381-949bcd7165dc tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:25.920154 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-77dbb8b5-90aa-4270-a381-949bcd7165dc tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:25.920154 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-77dbb8b5-90aa-4270-a381-949bcd7165dc tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:26.017902 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-da2e3f5b-4b75-44ce-b93d-46cae4e88913 req-bfda16fa-7a33-4e86-be72-5326e7ad7b22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907", "tag": "f866082a-76d6-466b-8c49-7a5068d4d87f"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:46:26.037994 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-da2e3f5b-4b75-44ce-b93d-46cae4e88913 req-bfda16fa-7a33-4e86-be72-5326e7ad7b22 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:26.038977 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-da2e3f5b-4b75-44ce-b93d-46cae4e88913 req-bfda16fa-7a33-4e86-be72-5326e7ad7b22 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:26.056471 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-da2e3f5b-4b75-44ce-b93d-46cae4e88913 req-bfda16fa-7a33-4e86-be72-5326e7ad7b22 service nova] Creating event network-changed:f866082a-76d6-466b-8c49-7a5068d4d87f for instance 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 on hv-cinder-83716 Jun 17 11:46:26.065590 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-da2e3f5b-4b75-44ce-b93d-46cae4e88913 req-bfda16fa-7a33-4e86-be72-5326e7ad7b22 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165027 Jun 17 11:46:26.069067 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 334/673] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:46:26.240425 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-66236c0c-1147-4db0-b6f2-0502c979552c tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:26.241332 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-66236c0c-1147-4db0-b6f2-0502c979552c tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:26.260373 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-66236c0c-1147-4db0-b6f2-0502c979552c tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:26.261095 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-66236c0c-1147-4db0-b6f2-0502c979552c tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:26.262085 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-66236c0c-1147-4db0-b6f2-0502c979552c tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:26.262676 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-66236c0c-1147-4db0-b6f2-0502c979552c tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:26.298568 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-77dbb8b5-90aa-4270-a381-949bcd7165dc tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:26.308498 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-77dbb8b5-90aa-4270-a381-949bcd7165dc tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1757 microversion: 2.1 time: 0.425150 Jun 17 11:46:26.312519 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 340/674] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:25 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1757 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:26.558880 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-66236c0c-1147-4db0-b6f2-0502c979552c tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:26.576193 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-66236c0c-1147-4db0-b6f2-0502c979552c tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892" status: 200 len: 1363 microversion: 2.1 time: 0.342288 Jun 17 11:46:26.577703 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 335/675] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:26 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 => generated 1363 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:26.669089 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-37f2c180-663d-4ffb-ac2b-37b27da06986 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:26.674131 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-37f2c180-663d-4ffb-ac2b-37b27da06986 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] [instance: 39a1319f-9f84-46db-9981-30ff7e4acc74] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:26.679540 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-37f2c180-663d-4ffb-ac2b-37b27da06986 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:26.680298 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-37f2c180-663d-4ffb-ac2b-37b27da06986 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:26.681284 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-37f2c180-663d-4ffb-ac2b-37b27da06986 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:26.681726 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-37f2c180-663d-4ffb-ac2b-37b27da06986 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:26.709463 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-37f2c180-663d-4ffb-ac2b-37b27da06986 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] HTTP exception thrown: Instance 39a1319f-9f84-46db-9981-30ff7e4acc74 could not be found. Jun 17 11:46:26.717548 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-37f2c180-663d-4ffb-ac2b-37b27da06986 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Request method failure captured: Jun 17 11:46:26.717548 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74 HTTP/1.1 Jun 17 11:46:26.717548 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jun 17 11:46:26.717548 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jun 17 11:46:26.717548 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Connection: close Jun 17 11:46:26.717548 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jun 17 11:46:26.717548 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jun 17 11:46:26.717548 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.45 Jun 17 11:46:26.717548 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jun 17 11:46:26.717548 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jun 17 11:46:26.717548 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABirGhYXPEneGbWlDHr4IdGyKcI2lSvyu7_ndCScBUrORne39u-qQqZEMZQFH6SJDovDOcnVKjNuoxzr715SnSXgShkw-ZY_5pruDdyzsw0BrOMIBFmyx6bizWQou_OUbd6ovLhc1PtNOl8-D1aQsyvMYXlGV0IY28idRqZ__sES5ASbXg Jun 17 11:46:26.717548 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jun 17 11:46:26.717548 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jun 17 11:46:26.717548 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jun 17 11:46:26.717548 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jun 17 11:46:26.717548 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jun 17 11:46:26.717548 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jun 17 11:46:26.717548 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Id: e38262ed2ed84004a6e01d423cadcae4 Jun 17 11:46:26.717548 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1413190309 Jun 17 11:46:26.717548 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jun 17 11:46:26.717548 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jun 17 11:46:26.719945 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e38262ed2ed84004a6e01d423cadcae4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e38262ed2ed84004a6e01d423cadcae4", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e38262ed2ed84004a6e01d423cadcae4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e38262ed2ed84004a6e01d423cadcae4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:46:26.719945 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1413190309 Jun 17 11:46:26.719945 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: e38262ed2ed84004a6e01d423cadcae4 Jun 17 11:46:26.719945 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1413190309 Jun 17 11:46:26.719945 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User: tempest-ServerRescueNegativeTestJSON-1413190309-project Jun 17 11:46:26.719945 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jun 17 11:46:26.719945 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jun 17 11:46:26.719945 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Id: a79957b3f2e94f31bd2cb82290ed0962 Jun 17 11:46:26.719945 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1413190309-project Jun 17 11:46:26.719945 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: method: > Jun 17 11:46:26.719945 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: exception: Instance 39a1319f-9f84-46db-9981-30ff7e4acc74 could not be found. Jun 17 11:46:26.719945 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: action_args: {'id': '39a1319f-9f84-46db-9981-30ff7e4acc74'} Jun 17 11:46:26.721175 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:46:26.721175 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:46:26.721175 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:46:26.721175 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:46:26.721175 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:46:26.721175 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:46:26.721175 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:46:26.721175 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:46:26.721175 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:46:26.721175 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:46:26.721175 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39a1319f-9f84-46db-9981-30ff7e4acc74 could not be found. Jun 17 11:46:26.721175 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:46:26.721175 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:46:26.721175 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:46:26.721175 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:46:26.721175 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:46:26.721175 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:46:26.721175 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:46:26.721175 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:46:26.721175 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:46:26.722682 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:46:26.722682 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 11:46:26.722682 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 11:46:26.722682 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:46:26.722682 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:46:26.722682 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:46:26.722682 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:46:26.722682 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39a1319f-9f84-46db-9981-30ff7e4acc74 could not be found. Jun 17 11:46:26.722682 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:46:26.722682 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:46:26.722682 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:46:26.722682 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:46:26.722682 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:46:26.722682 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:46:26.722682 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:46:26.722682 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:46:26.722682 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39a1319f-9f84-46db-9981-30ff7e4acc74 could not be found. Jun 17 11:46:26.722682 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:46:26.724333 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-37f2c180-663d-4ffb-ac2b-37b27da06986 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] Returning 404 to user: Instance 39a1319f-9f84-46db-9981-30ff7e4acc74 could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:46:26.724333 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-37f2c180-663d-4ffb-ac2b-37b27da06986 tempest-ServerRescueNegativeTestJSON-1413190309 tempest-ServerRescueNegativeTestJSON-1413190309-project] 10.222.0.45 "GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74" status: 404 len: 111 microversion: 2.1 time: 0.059494 Jun 17 11:46:26.724333 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 341/676] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:26 2022] GET /compute/v2.1/servers/39a1319f-9f84-46db-9981-30ff7e4acc74 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:46:27.321244 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-bf15a598-328b-482d-84e9-f2fd613b47b1 req-8ee1a66f-3dcb-4194-938f-1e92cbf52362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ed47de2-4bfc-4635-8345-47b1cc369892", "name": "network-vif-plugged", "status": "completed", "tag": "4272e231-ff05-439d-a324-ff813464d4bb"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:46:27.350472 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-bf15a598-328b-482d-84e9-f2fd613b47b1 req-8ee1a66f-3dcb-4194-938f-1e92cbf52362 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:27.350835 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-bf15a598-328b-482d-84e9-f2fd613b47b1 req-8ee1a66f-3dcb-4194-938f-1e92cbf52362 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:27.364498 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-bf15a598-328b-482d-84e9-f2fd613b47b1 req-8ee1a66f-3dcb-4194-938f-1e92cbf52362 service nova] Creating event network-vif-plugged:4272e231-ff05-439d-a324-ff813464d4bb for instance 2ed47de2-4bfc-4635-8345-47b1cc369892 on hv-cinder-83716 Jun 17 11:46:27.370894 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-bf15a598-328b-482d-84e9-f2fd613b47b1 req-8ee1a66f-3dcb-4194-938f-1e92cbf52362 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056757 Jun 17 11:46:27.372220 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 336/677] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:46:27.602361 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9bbb4807-8050-48df-a731-9ada3c3e40d0 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:27.603733 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9bbb4807-8050-48df-a731-9ada3c3e40d0 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:27.624294 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9bbb4807-8050-48df-a731-9ada3c3e40d0 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:27.625324 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9bbb4807-8050-48df-a731-9ada3c3e40d0 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:27.626845 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9bbb4807-8050-48df-a731-9ada3c3e40d0 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:27.627483 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9bbb4807-8050-48df-a731-9ada3c3e40d0 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:27.901577 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9bbb4807-8050-48df-a731-9ada3c3e40d0 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:27.913093 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9bbb4807-8050-48df-a731-9ada3c3e40d0 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892" status: 200 len: 1363 microversion: 2.1 time: 0.314740 Jun 17 11:46:27.914601 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 342/678] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:27 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 => generated 1363 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:46:28.139215 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-85012716-e24e-43ed-be9f-f84d6aa76dd1 req-b4ccdd9a-3a4d-412a-96e3-a2fbe7d37fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef2e4aca-bc09-41dd-9f63-3a8649cf871c", "tag": "0b44766a-48d1-49bc-a348-b25e0252287f"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:46:28.148469 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-85012716-e24e-43ed-be9f-f84d6aa76dd1 req-b4ccdd9a-3a4d-412a-96e3-a2fbe7d37fd8 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:28.148922 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-85012716-e24e-43ed-be9f-f84d6aa76dd1 req-b4ccdd9a-3a4d-412a-96e3-a2fbe7d37fd8 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:28.164147 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-85012716-e24e-43ed-be9f-f84d6aa76dd1 req-b4ccdd9a-3a4d-412a-96e3-a2fbe7d37fd8 service nova] Creating event network-changed:0b44766a-48d1-49bc-a348-b25e0252287f for instance ef2e4aca-bc09-41dd-9f63-3a8649cf871c on hv-cinder-83716 Jun 17 11:46:28.169113 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-85012716-e24e-43ed-be9f-f84d6aa76dd1 req-b4ccdd9a-3a4d-412a-96e3-a2fbe7d37fd8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034353 Jun 17 11:46:28.169721 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 337/679] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:46:28.934057 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0cb1a5eb-ef6d-498a-b575-3d831962bcc5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:28.935320 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0cb1a5eb-ef6d-498a-b575-3d831962bcc5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:28.942435 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0cb1a5eb-ef6d-498a-b575-3d831962bcc5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:28.943442 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0cb1a5eb-ef6d-498a-b575-3d831962bcc5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:28.944695 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0cb1a5eb-ef6d-498a-b575-3d831962bcc5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:28.945140 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0cb1a5eb-ef6d-498a-b575-3d831962bcc5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:29.598322 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0cb1a5eb-ef6d-498a-b575-3d831962bcc5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:29.600789 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=100 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:46:29.626089 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0cb1a5eb-ef6d-498a-b575-3d831962bcc5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892" status: 200 len: 1363 microversion: 2.1 time: 0.695631 Jun 17 11:46:29.629188 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 343/680] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:28 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 => generated 1363 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:30.656674 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-34466928-9494-49fc-9345-952a4f4ca8f1 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:30.658597 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-34466928-9494-49fc-9345-952a4f4ca8f1 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:30.665309 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-34466928-9494-49fc-9345-952a4f4ca8f1 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:30.665754 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-34466928-9494-49fc-9345-952a4f4ca8f1 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:30.666522 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-34466928-9494-49fc-9345-952a4f4ca8f1 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:30.666949 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-34466928-9494-49fc-9345-952a4f4ca8f1 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:30.844778 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-34466928-9494-49fc-9345-952a4f4ca8f1 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:30.860861 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-34466928-9494-49fc-9345-952a4f4ca8f1 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892" status: 200 len: 1548 microversion: 2.1 time: 0.209139 Jun 17 11:46:30.861793 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 338/681] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:30 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 => generated 1548 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:30.879549 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0a6f6b35-d158-4882-a92e-54dd6106d1d9 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:30.880476 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0a6f6b35-d158-4882-a92e-54dd6106d1d9 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:30.888142 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0a6f6b35-d158-4882-a92e-54dd6106d1d9 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:30.888939 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0a6f6b35-d158-4882-a92e-54dd6106d1d9 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:30.889741 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0a6f6b35-d158-4882-a92e-54dd6106d1d9 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:30.890170 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0a6f6b35-d158-4882-a92e-54dd6106d1d9 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:30.980986 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0a6f6b35-d158-4882-a92e-54dd6106d1d9 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106075 Jun 17 11:46:30.981595 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 344/682] 10.222.0.45 () {58 vars in 1274 bytes} [Fri Jun 17 11:46:30 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:46:32.321417 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-b19ecda4-a700-4dff-9480-f723c894bc5e req-95fe0fb2-9738-48ed-9f31-7beab251e8cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ed47de2-4bfc-4635-8345-47b1cc369892", "tag": "4272e231-ff05-439d-a324-ff813464d4bb"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:46:32.330046 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-b19ecda4-a700-4dff-9480-f723c894bc5e req-95fe0fb2-9738-48ed-9f31-7beab251e8cc service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:32.330586 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-b19ecda4-a700-4dff-9480-f723c894bc5e req-95fe0fb2-9738-48ed-9f31-7beab251e8cc service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:32.342744 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-b19ecda4-a700-4dff-9480-f723c894bc5e req-95fe0fb2-9738-48ed-9f31-7beab251e8cc service nova] Creating event network-changed:4272e231-ff05-439d-a324-ff813464d4bb for instance 2ed47de2-4bfc-4635-8345-47b1cc369892 on hv-cinder-83716 Jun 17 11:46:32.348322 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-b19ecda4-a700-4dff-9480-f723c894bc5e req-95fe0fb2-9738-48ed-9f31-7beab251e8cc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031066 Jun 17 11:46:32.349182 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 339/683] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:46:34.760807 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-1e194831-18d6-4d90-b692-156e59859e9a tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] Action: 'create', calling method: .version_select at 0x7f9c768d7280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1801965542"}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:46:35.667723 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-1e194831-18d6-4d90-b692-156e59859e9a tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.022918 Jun 17 11:46:35.668412 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 345/684] 10.222.0.45 () {60 vars in 1154 bytes} [Fri Jun 17 11:46:34 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1024 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 17 11:46:35.682692 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a7a6e032-600e-40f5-b304-e2d823f80a64 tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] Calling method '.version_select at 0x7f9c7681b5e0>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:35.735985 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a7a6e032-600e-40f5-b304-e2d823f80a64 tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/81805557-f2a4-4032-b8e3-31d74ccabb19" status: 200 len: 345 microversion: 2.1 time: 0.054575 Jun 17 11:46:35.735985 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 340/685] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jun 17 11:46:35 2022] GET /compute/v2.1/os-volumes/81805557-f2a4-4032-b8e3-31d74ccabb19 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:46:36.746923 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-33471cb6-fc31-40a7-9b87-2ef01b79d1c3 tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] Calling method '.version_select at 0x7f9c7678d1f0>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:36.793516 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-33471cb6-fc31-40a7-9b87-2ef01b79d1c3 tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/81805557-f2a4-4032-b8e3-31d74ccabb19" status: 200 len: 346 microversion: 2.1 time: 0.051123 Jun 17 11:46:36.794088 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 346/686] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jun 17 11:46:36 2022] GET /compute/v2.1/os-volumes/81805557-f2a4-4032-b8e3-31d74ccabb19 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:46:36.814697 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-52d3a666-4f4d-4498-af04-4b45449856cb tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] Action: 'create', calling method: .version_select at 0x7f9c7691fc10>, body: {"snapshot": {"volume_id": "81805557-f2a4-4032-b8e3-31d74ccabb19", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1520684490"}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:46:37.344717 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-52d3a666-4f4d-4498-af04-4b45449856cb tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] 10.222.0.45 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.534407 Jun 17 11:46:37.345582 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 341/687] 10.222.0.45 () {60 vars in 1161 bytes} [Fri Jun 17 11:46:36 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:46:37.355973 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9abfe65e-e6e6-4d57-b3c1-b5c1279741eb tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] Calling method '.version_select at 0x7f9c767ac5e0>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:37.391875 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9abfe65e-e6e6-4d57-b3c1-b5c1279741eb tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/6bc58d13-e229-4393-8e66-834c440b0d66" status: 200 len: 287 microversion: 2.1 time: 0.039266 Jun 17 11:46:37.392447 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 347/688] 10.222.0.45 () {58 vars in 1250 bytes} [Fri Jun 17 11:46:37 2022] GET /compute/v2.1/os-snapshots/6bc58d13-e229-4393-8e66-834c440b0d66 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:46:37.402877 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-432c4e19-e553-487e-8909-3e90c277c452 tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] Calling method '.version_select at 0x7f9c7680ddc0>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:37.435510 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-432c4e19-e553-487e-8909-3e90c277c452 tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.036323 Jun 17 11:46:37.436076 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 342/689] 10.222.0.45 () {58 vars in 1139 bytes} [Fri Jun 17 11:46:37 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:46:37.447480 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8e02a10b-a7cf-4152-810b-11a1370c5c6c tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] Calling method '.version_select at 0x7f9c7695bca0>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:37.478564 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-8e02a10b-a7cf-4152-810b-11a1370c5c6c tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/6bc58d13-e229-4393-8e66-834c440b0d66" status: 200 len: 287 microversion: 2.1 time: 0.034919 Jun 17 11:46:37.479144 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 348/690] 10.222.0.45 () {58 vars in 1250 bytes} [Fri Jun 17 11:46:37 2022] GET /compute/v2.1/os-snapshots/6bc58d13-e229-4393-8e66-834c440b0d66 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:46:38.491573 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-66e1c2c3-b8a3-4c84-98ba-05b85ccb9bd3 tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] Calling method '.version_select at 0x7f9c76804d30>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:38.521941 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-66e1c2c3-b8a3-4c84-98ba-05b85ccb9bd3 tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/6bc58d13-e229-4393-8e66-834c440b0d66" status: 200 len: 287 microversion: 2.1 time: 0.034721 Jun 17 11:46:38.522625 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 343/691] 10.222.0.45 () {58 vars in 1250 bytes} [Fri Jun 17 11:46:38 2022] GET /compute/v2.1/os-snapshots/6bc58d13-e229-4393-8e66-834c440b0d66 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:46:39.536655 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a7d48a35-61f1-410b-8932-400656a24369 tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] Calling method '.version_select at 0x7f9c767d3ee0>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:39.568648 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a7d48a35-61f1-410b-8932-400656a24369 tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/6bc58d13-e229-4393-8e66-834c440b0d66" status: 200 len: 287 microversion: 2.1 time: 0.038470 Jun 17 11:46:39.569780 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 349/692] 10.222.0.45 () {58 vars in 1250 bytes} [Fri Jun 17 11:46:39 2022] GET /compute/v2.1/os-snapshots/6bc58d13-e229-4393-8e66-834c440b0d66 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:46:40.581347 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-dad63327-ef76-4dea-9b04-6bd8d298558f tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] Calling method '.version_select at 0x7f9c7680d160>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:40.610896 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-dad63327-ef76-4dea-9b04-6bd8d298558f tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/6bc58d13-e229-4393-8e66-834c440b0d66" status: 200 len: 287 microversion: 2.1 time: 0.034279 Jun 17 11:46:40.611498 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 344/693] 10.222.0.45 () {58 vars in 1250 bytes} [Fri Jun 17 11:46:40 2022] GET /compute/v2.1/os-snapshots/6bc58d13-e229-4393-8e66-834c440b0d66 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:46:41.620237 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:46:41.621745 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=5 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:46:41.627906 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b6222fce-ed35-4890-9e21-917203571372 tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] Calling method '.version_select at 0x7f9c768d7280>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:41.659791 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b6222fce-ed35-4890-9e21-917203571372 tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/6bc58d13-e229-4393-8e66-834c440b0d66" status: 200 len: 288 microversion: 2.1 time: 0.041279 Jun 17 11:46:41.660364 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 350/694] 10.222.0.45 () {58 vars in 1250 bytes} [Fri Jun 17 11:46:41 2022] GET /compute/v2.1/os-snapshots/6bc58d13-e229-4393-8e66-834c440b0d66 => generated 288 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:46:41.671965 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c3fc4737-5671-45b0-ac10-82097a024a17 tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] Calling method '.version_select at 0x7f9c76780430>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:41.839142 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c3fc4737-5671-45b0-ac10-82097a024a17 tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] 10.222.0.45 "DELETE /compute/v2.1/os-snapshots/6bc58d13-e229-4393-8e66-834c440b0d66" status: 202 len: 0 microversion: 2.1 time: 0.168244 Jun 17 11:46:41.839142 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 345/695] 10.222.0.45 () {58 vars in 1253 bytes} [Fri Jun 17 11:46:41 2022] DELETE /compute/v2.1/os-snapshots/6bc58d13-e229-4393-8e66-834c440b0d66 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 11:46:41.846334 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-d2c25fe4-1d4b-4545-8c9f-4082ee9fb2d8 tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] Calling method '.version_select at 0x7f9c767d3670>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:41.877534 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-d2c25fe4-1d4b-4545-8c9f-4082ee9fb2d8 tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/6bc58d13-e229-4393-8e66-834c440b0d66" status: 200 len: 287 microversion: 2.1 time: 0.036599 Jun 17 11:46:41.878162 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 351/696] 10.222.0.45 () {58 vars in 1250 bytes} [Fri Jun 17 11:46:41 2022] GET /compute/v2.1/os-snapshots/6bc58d13-e229-4393-8e66-834c440b0d66 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:46:42.886062 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:46:42.886984 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:46:42.891860 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f305646b-b406-42e5-95c9-7f52cca412a5 tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] Calling method '.version_select at 0x7f9c76786700>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:42.920808 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-f305646b-b406-42e5-95c9-7f52cca412a5 tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] HTTP exception thrown: Snapshot 6bc58d13-e229-4393-8e66-834c440b0d66 could not be found. Jun 17 11:46:42.924758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f305646b-b406-42e5-95c9-7f52cca412a5 tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] Request method failure captured: Jun 17 11:46:42.924758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: request: GET /compute/v2.1/os-snapshots/6bc58d13-e229-4393-8e66-834c440b0d66 HTTP/1.1 Jun 17 11:46:42.924758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept: application/json Jun 17 11:46:42.924758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jun 17 11:46:42.924758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Connection: close Jun 17 11:46:42.924758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jun 17 11:46:42.924758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jun 17 11:46:42.924758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Host: 10.222.0.45 Jun 17 11:46:42.924758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jun 17 11:46:42.924758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jun 17 11:46:42.924758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABirGmacUmeiZI4o3jzZjjeEKau_seZI_qn9ghK5eGp69Ov12ep_qBHwdn7eZIR0xT5N9QZY9M6F1cati_is97_GcZIFfF-siLbq3scA25mRfsjFmlMpv6Pm5I8-7Lute-Z2s0q6dFgyGdE1-Wjm7ElnEVloS3zrmqfAKaV5xXRZuQxtGo Jun 17 11:46:42.924758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jun 17 11:46:42.924758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jun 17 11:46:42.924758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jun 17 11:46:42.924758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jun 17 11:46:42.924758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jun 17 11:46:42.924758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jun 17 11:46:42.924758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Id: eb23f3e263ee41169088479575252eb4 Jun 17 11:46:42.924758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1471038190 Jun 17 11:46:42.924758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Role: member,reader Jun 17 11:46:42.924758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Roles: member,reader Jun 17 11:46:42.926951 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/eb23f3e263ee41169088479575252eb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_eb23f3e263ee41169088479575252eb4", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eb23f3e263ee41169088479575252eb4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eb23f3e263ee41169088479575252eb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:46:42.926951 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1471038190 Jun 17 11:46:42.926951 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Id: eb23f3e263ee41169088479575252eb4 Jun 17 11:46:42.926951 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1471038190 Jun 17 11:46:42.926951 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User: tempest-VolumesSnapshotsTestJSON-1471038190-project Jun 17 11:46:42.926951 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jun 17 11:46:42.926951 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jun 17 11:46:42.926951 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Id: c6564be085454ebeb649fc630d501899 Jun 17 11:46:42.926951 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1471038190-project Jun 17 11:46:42.926951 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: method: Jun 17 11:46:42.926951 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: exception: Snapshot 6bc58d13-e229-4393-8e66-834c440b0d66 could not be found. Jun 17 11:46:42.926951 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: action_args: {'id': '6bc58d13-e229-4393-8e66-834c440b0d66'} Jun 17 11:46:42.926951 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:46:42.928229 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:46:42.928229 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 17 11:46:42.928229 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 17 11:46:42.928229 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 17 11:46:42.928229 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 17 11:46:42.928229 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 17 11:46:42.928229 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 17 11:46:42.928229 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 11:46:42.928229 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 11:46:42.928229 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 11:46:42.928229 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 11:46:42.928229 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 11:46:42.928229 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 11:46:42.928229 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 11:46:42.928229 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 11:46:42.928229 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6bc58d13-e229-4393-8e66-834c440b0d66 could not be found. (HTTP 404) (Request-ID: req-5417048d-d967-4c4a-858f-845fd2812458) Jun 17 11:46:42.928229 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:46:42.928229 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:46:42.930354 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:46:42.930354 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:46:42.930354 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 17 11:46:42.930354 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 17 11:46:42.930354 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 11:46:42.930354 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 11:46:42.930354 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 17 11:46:42.930354 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 17 11:46:42.930354 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 11:46:42.930354 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 11:46:42.930354 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 17 11:46:42.930354 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 17 11:46:42.930354 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 17 11:46:42.930354 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 17 11:46:42.930354 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 17 11:46:42.930354 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 17 11:46:42.930354 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 11:46:42.930354 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 11:46:42.930354 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 11:46:42.932599 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 11:46:42.932599 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 11:46:42.932599 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 11:46:42.932599 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 11:46:42.932599 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 11:46:42.932599 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6bc58d13-e229-4393-8e66-834c440b0d66 could not be found. Jun 17 11:46:42.932599 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:46:42.932599 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:46:42.932599 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:46:42.932599 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:46:42.932599 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:46:42.932599 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:46:42.932599 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:46:42.932599 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:46:42.932599 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 11:46:42.932599 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 11:46:42.932599 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:46:42.932599 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:46:42.932599 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 17 11:46:42.932599 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:46:42.934774 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6bc58d13-e229-4393-8e66-834c440b0d66 could not be found. Jun 17 11:46:42.934774 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:46:42.934774 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:46:42.934774 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:46:42.934774 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:46:42.934774 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:46:42.934774 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:46:42.934774 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:46:42.934774 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:46:42.934774 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6bc58d13-e229-4393-8e66-834c440b0d66 could not be found. Jun 17 11:46:42.934774 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:46:42.934774 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f305646b-b406-42e5-95c9-7f52cca412a5 tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] Returning 404 to user: Snapshot 6bc58d13-e229-4393-8e66-834c440b0d66 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:46:42.934774 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f305646b-b406-42e5-95c9-7f52cca412a5 tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/6bc58d13-e229-4393-8e66-834c440b0d66" status: 404 len: 111 microversion: 2.1 time: 0.041646 Jun 17 11:46:42.936199 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 346/697] 10.222.0.45 () {58 vars in 1250 bytes} [Fri Jun 17 11:46:42 2022] GET /compute/v2.1/os-snapshots/6bc58d13-e229-4393-8e66-834c440b0d66 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:46:42.940774 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c71ab6a0-bc78-4bf2-ae41-edc9a0296218 tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] Calling method '.version_select at 0x7f9c767aadc0>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:43.255290 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c71ab6a0-bc78-4bf2-ae41-edc9a0296218 tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/81805557-f2a4-4032-b8e3-31d74ccabb19" status: 202 len: 0 microversion: 2.1 time: 0.321799 Jun 17 11:46:43.255950 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 352/698] 10.222.0.45 () {58 vars in 1247 bytes} [Fri Jun 17 11:46:42 2022] DELETE /compute/v2.1/os-volumes/81805557-f2a4-4032-b8e3-31d74ccabb19 => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 17 11:46:43.265407 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-957bfdfd-9e86-4465-aece-613baf5d4d1a tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] Calling method '.version_select at 0x7f9c768d2670>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:43.315357 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-957bfdfd-9e86-4465-aece-613baf5d4d1a tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/81805557-f2a4-4032-b8e3-31d74ccabb19" status: 200 len: 345 microversion: 2.1 time: 0.054940 Jun 17 11:46:43.316076 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 347/699] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jun 17 11:46:43 2022] GET /compute/v2.1/os-volumes/81805557-f2a4-4032-b8e3-31d74ccabb19 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:46:44.328993 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a9bf4188-e686-42b2-8cee-b3c18e83aa1c tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] Calling method '.version_select at 0x7f9c767ac550>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:44.361955 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-a9bf4188-e686-42b2-8cee-b3c18e83aa1c tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] HTTP exception thrown: Volume 81805557-f2a4-4032-b8e3-31d74ccabb19 could not be found. Jun 17 11:46:44.365410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a9bf4188-e686-42b2-8cee-b3c18e83aa1c tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] Request method failure captured: Jun 17 11:46:44.365410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/os-volumes/81805557-f2a4-4032-b8e3-31d74ccabb19 HTTP/1.1 Jun 17 11:46:44.365410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jun 17 11:46:44.365410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jun 17 11:46:44.365410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Connection: close Jun 17 11:46:44.365410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jun 17 11:46:44.365410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jun 17 11:46:44.365410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.45 Jun 17 11:46:44.365410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jun 17 11:46:44.365410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jun 17 11:46:44.365410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABirGmacUmeiZI4o3jzZjjeEKau_seZI_qn9ghK5eGp69Ov12ep_qBHwdn7eZIR0xT5N9QZY9M6F1cati_is97_GcZIFfF-siLbq3scA25mRfsjFmlMpv6Pm5I8-7Lute-Z2s0q6dFgyGdE1-Wjm7ElnEVloS3zrmqfAKaV5xXRZuQxtGo Jun 17 11:46:44.365410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jun 17 11:46:44.365410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jun 17 11:46:44.365410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jun 17 11:46:44.365410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jun 17 11:46:44.365410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jun 17 11:46:44.365410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jun 17 11:46:44.365410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Id: eb23f3e263ee41169088479575252eb4 Jun 17 11:46:44.365410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1471038190 Jun 17 11:46:44.365410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jun 17 11:46:44.365410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jun 17 11:46:44.367751 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/eb23f3e263ee41169088479575252eb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_eb23f3e263ee41169088479575252eb4", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eb23f3e263ee41169088479575252eb4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eb23f3e263ee41169088479575252eb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:46:44.367751 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1471038190 Jun 17 11:46:44.367751 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: eb23f3e263ee41169088479575252eb4 Jun 17 11:46:44.367751 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1471038190 Jun 17 11:46:44.367751 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User: tempest-VolumesSnapshotsTestJSON-1471038190-project Jun 17 11:46:44.367751 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jun 17 11:46:44.367751 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jun 17 11:46:44.367751 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Id: c6564be085454ebeb649fc630d501899 Jun 17 11:46:44.367751 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1471038190-project Jun 17 11:46:44.367751 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: method: Jun 17 11:46:44.367751 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: exception: Volume 81805557-f2a4-4032-b8e3-31d74ccabb19 could not be found. Jun 17 11:46:44.367751 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: action_args: {'id': '81805557-f2a4-4032-b8e3-31d74ccabb19'} Jun 17 11:46:44.367751 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:46:44.369159 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:46:44.369159 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 11:46:44.369159 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 11:46:44.369159 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 11:46:44.369159 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 11:46:44.369159 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 11:46:44.369159 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 11:46:44.369159 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 11:46:44.369159 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 11:46:44.369159 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 11:46:44.369159 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 11:46:44.369159 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 11:46:44.369159 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 11:46:44.369159 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 11:46:44.369159 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 11:46:44.369159 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 81805557-f2a4-4032-b8e3-31d74ccabb19 could not be found. (HTTP 404) (Request-ID: req-4de5ddbe-9330-4b38-8762-88c5a6c09eb3) Jun 17 11:46:44.369159 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:46:44.369159 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:46:44.369159 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:46:44.371410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:46:44.371410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 17 11:46:44.371410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 17 11:46:44.371410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 11:46:44.371410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 11:46:44.371410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 11:46:44.371410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 11:46:44.371410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 11:46:44.371410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 11:46:44.371410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 11:46:44.371410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 11:46:44.371410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 11:46:44.371410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 11:46:44.371410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 11:46:44.371410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 11:46:44.371410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 11:46:44.371410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 11:46:44.371410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 11:46:44.371410 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 11:46:44.374049 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 11:46:44.374049 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 11:46:44.374049 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 11:46:44.374049 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 11:46:44.374049 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 81805557-f2a4-4032-b8e3-31d74ccabb19 could not be found. Jun 17 11:46:44.374049 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:46:44.374049 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:46:44.374049 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:46:44.374049 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:46:44.374049 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:46:44.374049 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:46:44.374049 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:46:44.374049 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:46:44.374049 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 11:46:44.374049 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 11:46:44.374049 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:46:44.374049 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:46:44.374049 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 17 11:46:44.374049 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:46:44.376643 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 81805557-f2a4-4032-b8e3-31d74ccabb19 could not be found. Jun 17 11:46:44.376643 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:46:44.376643 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:46:44.376643 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:46:44.376643 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:46:44.376643 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:46:44.376643 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:46:44.376643 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:46:44.376643 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:46:44.376643 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 81805557-f2a4-4032-b8e3-31d74ccabb19 could not be found. Jun 17 11:46:44.376643 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:46:44.376643 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a9bf4188-e686-42b2-8cee-b3c18e83aa1c tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] Returning 404 to user: Volume 81805557-f2a4-4032-b8e3-31d74ccabb19 could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:46:44.376643 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a9bf4188-e686-42b2-8cee-b3c18e83aa1c tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/81805557-f2a4-4032-b8e3-31d74ccabb19" status: 404 len: 109 microversion: 2.1 time: 0.042577 Jun 17 11:46:44.376643 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 353/700] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jun 17 11:46:44 2022] GET /compute/v2.1/os-volumes/81805557-f2a4-4032-b8e3-31d74ccabb19 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:46:44.383805 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4e54ed0d-79c7-4be8-851e-56e0ff008004 tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] Calling method '.version_select at 0x7f9c773031f0>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:44.419120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-4e54ed0d-79c7-4be8-851e-56e0ff008004 tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] HTTP exception thrown: Volume 81805557-f2a4-4032-b8e3-31d74ccabb19 could not be found. Jun 17 11:46:44.421138 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4e54ed0d-79c7-4be8-851e-56e0ff008004 tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] Request method failure captured: Jun 17 11:46:44.421138 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: request: DELETE /compute/v2.1/os-volumes/81805557-f2a4-4032-b8e3-31d74ccabb19 HTTP/1.1 Jun 17 11:46:44.421138 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept: application/json Jun 17 11:46:44.421138 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jun 17 11:46:44.421138 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Connection: close Jun 17 11:46:44.421138 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jun 17 11:46:44.421138 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jun 17 11:46:44.421138 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Host: 10.222.0.45 Jun 17 11:46:44.421138 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jun 17 11:46:44.421138 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jun 17 11:46:44.421138 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABirGmacUmeiZI4o3jzZjjeEKau_seZI_qn9ghK5eGp69Ov12ep_qBHwdn7eZIR0xT5N9QZY9M6F1cati_is97_GcZIFfF-siLbq3scA25mRfsjFmlMpv6Pm5I8-7Lute-Z2s0q6dFgyGdE1-Wjm7ElnEVloS3zrmqfAKaV5xXRZuQxtGo Jun 17 11:46:44.421138 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jun 17 11:46:44.421138 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jun 17 11:46:44.421138 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jun 17 11:46:44.421138 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jun 17 11:46:44.421138 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jun 17 11:46:44.421138 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jun 17 11:46:44.421138 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Id: eb23f3e263ee41169088479575252eb4 Jun 17 11:46:44.421138 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1471038190 Jun 17 11:46:44.421138 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Role: member,reader Jun 17 11:46:44.421138 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Roles: member,reader Jun 17 11:46:44.423516 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/eb23f3e263ee41169088479575252eb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_eb23f3e263ee41169088479575252eb4", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eb23f3e263ee41169088479575252eb4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eb23f3e263ee41169088479575252eb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:46:44.423516 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1471038190 Jun 17 11:46:44.423516 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Id: eb23f3e263ee41169088479575252eb4 Jun 17 11:46:44.423516 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1471038190 Jun 17 11:46:44.423516 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User: tempest-VolumesSnapshotsTestJSON-1471038190-project Jun 17 11:46:44.423516 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jun 17 11:46:44.423516 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jun 17 11:46:44.423516 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Id: c6564be085454ebeb649fc630d501899 Jun 17 11:46:44.423516 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1471038190-project Jun 17 11:46:44.423516 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: method: Jun 17 11:46:44.423516 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: exception: Volume 81805557-f2a4-4032-b8e3-31d74ccabb19 could not be found. Jun 17 11:46:44.423516 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: action_args: {'id': '81805557-f2a4-4032-b8e3-31d74ccabb19'} Jun 17 11:46:44.423516 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:46:44.424717 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:46:44.424717 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 11:46:44.424717 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 11:46:44.424717 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 11:46:44.424717 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 11:46:44.424717 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 11:46:44.424717 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 11:46:44.424717 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 11:46:44.424717 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 11:46:44.424717 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 11:46:44.424717 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 11:46:44.424717 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 11:46:44.424717 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 11:46:44.424717 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 11:46:44.424717 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 11:46:44.424717 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 81805557-f2a4-4032-b8e3-31d74ccabb19 could not be found. (HTTP 404) (Request-ID: req-8edec495-1759-4a4b-a18d-cbfaf1dde384) Jun 17 11:46:44.424717 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:46:44.424717 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:46:44.424717 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:46:44.426292 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:46:44.426292 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 17 11:46:44.426292 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 17 11:46:44.426292 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 11:46:44.426292 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 11:46:44.426292 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 11:46:44.426292 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 11:46:44.426292 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 11:46:44.426292 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 11:46:44.426292 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 11:46:44.426292 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 11:46:44.426292 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 11:46:44.426292 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 11:46:44.426292 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 11:46:44.426292 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 11:46:44.426292 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 11:46:44.426292 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 11:46:44.426292 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 11:46:44.426292 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 11:46:44.427817 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 11:46:44.427817 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 11:46:44.427817 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 11:46:44.427817 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 11:46:44.427817 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 81805557-f2a4-4032-b8e3-31d74ccabb19 could not be found. Jun 17 11:46:44.427817 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:46:44.427817 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:46:44.427817 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:46:44.427817 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:46:44.427817 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:46:44.427817 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:46:44.427817 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:46:44.427817 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:46:44.427817 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 11:46:44.427817 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 11:46:44.427817 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:46:44.427817 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:46:44.427817 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 17 11:46:44.427817 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:46:44.429387 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 81805557-f2a4-4032-b8e3-31d74ccabb19 could not be found. Jun 17 11:46:44.429387 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:46:44.429387 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:46:44.429387 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:46:44.429387 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:46:44.429387 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:46:44.429387 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:46:44.429387 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:46:44.429387 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:46:44.429387 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 81805557-f2a4-4032-b8e3-31d74ccabb19 could not be found. Jun 17 11:46:44.429387 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:46:44.429387 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4e54ed0d-79c7-4be8-851e-56e0ff008004 tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] Returning 404 to user: Volume 81805557-f2a4-4032-b8e3-31d74ccabb19 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:46:44.429387 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4e54ed0d-79c7-4be8-851e-56e0ff008004 tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/81805557-f2a4-4032-b8e3-31d74ccabb19" status: 404 len: 109 microversion: 2.1 time: 0.044463 Jun 17 11:46:44.429387 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 348/701] 10.222.0.45 () {58 vars in 1247 bytes} [Fri Jun 17 11:46:44 2022] DELETE /compute/v2.1/os-volumes/81805557-f2a4-4032-b8e3-31d74ccabb19 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:46:44.434171 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ecfd7411-2645-475b-9bff-79e3094c62fb tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] Calling method '.version_select at 0x7f9c767ac430>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:44.464234 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-ecfd7411-2645-475b-9bff-79e3094c62fb tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] HTTP exception thrown: Volume 81805557-f2a4-4032-b8e3-31d74ccabb19 could not be found. Jun 17 11:46:44.466996 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ecfd7411-2645-475b-9bff-79e3094c62fb tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] Request method failure captured: Jun 17 11:46:44.466996 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/os-volumes/81805557-f2a4-4032-b8e3-31d74ccabb19 HTTP/1.1 Jun 17 11:46:44.466996 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jun 17 11:46:44.466996 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jun 17 11:46:44.466996 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Connection: close Jun 17 11:46:44.466996 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jun 17 11:46:44.466996 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jun 17 11:46:44.466996 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.45 Jun 17 11:46:44.466996 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jun 17 11:46:44.466996 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jun 17 11:46:44.466996 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABirGmacUmeiZI4o3jzZjjeEKau_seZI_qn9ghK5eGp69Ov12ep_qBHwdn7eZIR0xT5N9QZY9M6F1cati_is97_GcZIFfF-siLbq3scA25mRfsjFmlMpv6Pm5I8-7Lute-Z2s0q6dFgyGdE1-Wjm7ElnEVloS3zrmqfAKaV5xXRZuQxtGo Jun 17 11:46:44.466996 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jun 17 11:46:44.466996 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jun 17 11:46:44.466996 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jun 17 11:46:44.466996 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jun 17 11:46:44.466996 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jun 17 11:46:44.466996 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jun 17 11:46:44.466996 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Id: eb23f3e263ee41169088479575252eb4 Jun 17 11:46:44.466996 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1471038190 Jun 17 11:46:44.466996 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jun 17 11:46:44.466996 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jun 17 11:46:44.468890 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/eb23f3e263ee41169088479575252eb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_eb23f3e263ee41169088479575252eb4", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eb23f3e263ee41169088479575252eb4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eb23f3e263ee41169088479575252eb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:46:44.468890 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1471038190 Jun 17 11:46:44.468890 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: eb23f3e263ee41169088479575252eb4 Jun 17 11:46:44.468890 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1471038190 Jun 17 11:46:44.468890 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User: tempest-VolumesSnapshotsTestJSON-1471038190-project Jun 17 11:46:44.468890 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jun 17 11:46:44.468890 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jun 17 11:46:44.468890 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Id: c6564be085454ebeb649fc630d501899 Jun 17 11:46:44.468890 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1471038190-project Jun 17 11:46:44.468890 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: method: Jun 17 11:46:44.468890 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: exception: Volume 81805557-f2a4-4032-b8e3-31d74ccabb19 could not be found. Jun 17 11:46:44.468890 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: action_args: {'id': '81805557-f2a4-4032-b8e3-31d74ccabb19'} Jun 17 11:46:44.468890 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:46:44.469745 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:46:44.469745 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 11:46:44.469745 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 11:46:44.469745 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 11:46:44.469745 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 11:46:44.469745 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 11:46:44.469745 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 11:46:44.469745 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 11:46:44.469745 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 11:46:44.469745 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 11:46:44.469745 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 11:46:44.469745 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 11:46:44.469745 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 11:46:44.469745 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 11:46:44.469745 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 11:46:44.469745 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 81805557-f2a4-4032-b8e3-31d74ccabb19 could not be found. (HTTP 404) (Request-ID: req-0ee60b0f-f977-41a2-b870-237499da3ff1) Jun 17 11:46:44.469745 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:46:44.469745 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:46:44.469745 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:46:44.471933 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:46:44.471933 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 17 11:46:44.471933 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 17 11:46:44.471933 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 11:46:44.471933 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 11:46:44.471933 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 11:46:44.471933 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 11:46:44.471933 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 11:46:44.471933 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 11:46:44.471933 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 11:46:44.471933 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 11:46:44.471933 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 11:46:44.471933 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 11:46:44.471933 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 11:46:44.471933 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 11:46:44.471933 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 11:46:44.471933 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 11:46:44.471933 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 11:46:44.471933 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 11:46:44.473783 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 11:46:44.473783 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 11:46:44.473783 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 11:46:44.473783 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 11:46:44.473783 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 81805557-f2a4-4032-b8e3-31d74ccabb19 could not be found. Jun 17 11:46:44.473783 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:46:44.473783 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:46:44.473783 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:46:44.473783 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:46:44.473783 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:46:44.473783 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:46:44.473783 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:46:44.473783 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:46:44.473783 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 11:46:44.473783 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 11:46:44.473783 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:46:44.473783 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:46:44.473783 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 17 11:46:44.473783 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:46:44.475308 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 81805557-f2a4-4032-b8e3-31d74ccabb19 could not be found. Jun 17 11:46:44.475308 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:46:44.475308 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:46:44.475308 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:46:44.475308 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:46:44.475308 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:46:44.475308 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:46:44.475308 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:46:44.475308 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:46:44.475308 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 81805557-f2a4-4032-b8e3-31d74ccabb19 could not be found. Jun 17 11:46:44.475308 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:46:44.475308 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ecfd7411-2645-475b-9bff-79e3094c62fb tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] Returning 404 to user: Volume 81805557-f2a4-4032-b8e3-31d74ccabb19 could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:46:44.475308 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-ecfd7411-2645-475b-9bff-79e3094c62fb tempest-VolumesSnapshotsTestJSON-1471038190 tempest-VolumesSnapshotsTestJSON-1471038190-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/81805557-f2a4-4032-b8e3-31d74ccabb19" status: 404 len: 109 microversion: 2.1 time: 0.039453 Jun 17 11:46:44.475308 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 354/702] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jun 17 11:46:44 2022] GET /compute/v2.1/os-volumes/81805557-f2a4-4032-b8e3-31d74ccabb19 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:46:47.038427 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-568335be-627d-4a25-acd0-10f747cbb357 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:46:47.040277 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-568335be-627d-4a25-acd0-10f747cbb357 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:47.046973 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-568335be-627d-4a25-acd0-10f747cbb357 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:47.047548 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-568335be-627d-4a25-acd0-10f747cbb357 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:47.048330 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-568335be-627d-4a25-acd0-10f747cbb357 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:47.048769 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-568335be-627d-4a25-acd0-10f747cbb357 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:47.384791 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-568335be-627d-4a25-acd0-10f747cbb357 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "POST /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/action" status: 202 len: 0 microversion: 2.1 time: 0.351014 Jun 17 11:46:47.385457 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 349/703] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jun 17 11:46:47 2022] POST /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 11:46:47.395663 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2e8e97f2-cc84-4a0b-b854-57180030d7e9 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:47.396290 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2e8e97f2-cc84-4a0b-b854-57180030d7e9 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:47.403830 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2e8e97f2-cc84-4a0b-b854-57180030d7e9 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:47.404364 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2e8e97f2-cc84-4a0b-b854-57180030d7e9 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:47.405156 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2e8e97f2-cc84-4a0b-b854-57180030d7e9 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:47.405590 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2e8e97f2-cc84-4a0b-b854-57180030d7e9 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:47.565196 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2e8e97f2-cc84-4a0b-b854-57180030d7e9 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:47.576443 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2e8e97f2-cc84-4a0b-b854-57180030d7e9 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1749 microversion: 2.1 time: 0.183214 Jun 17 11:46:47.576443 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 355/704] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:47 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1749 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:48.592186 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-9113e48c-a256-4d54-82c5-e484e1e55fc4 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:48.592876 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-9113e48c-a256-4d54-82c5-e484e1e55fc4 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:48.599928 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9113e48c-a256-4d54-82c5-e484e1e55fc4 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:48.600341 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9113e48c-a256-4d54-82c5-e484e1e55fc4 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:48.601329 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9113e48c-a256-4d54-82c5-e484e1e55fc4 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:48.601771 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9113e48c-a256-4d54-82c5-e484e1e55fc4 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:48.760658 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-9113e48c-a256-4d54-82c5-e484e1e55fc4 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:48.769502 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-9113e48c-a256-4d54-82c5-e484e1e55fc4 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1754 microversion: 2.1 time: 0.181466 Jun 17 11:46:48.770101 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 350/705] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:48 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1754 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:49.687064 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-34959a2a-aa25-409e-86b7-473aa7089f51 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:49.687653 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-34959a2a-aa25-409e-86b7-473aa7089f51 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:49.694600 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-34959a2a-aa25-409e-86b7-473aa7089f51 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:49.695046 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-34959a2a-aa25-409e-86b7-473aa7089f51 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:49.695847 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-34959a2a-aa25-409e-86b7-473aa7089f51 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:49.700222 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-34959a2a-aa25-409e-86b7-473aa7089f51 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:49.726642 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-34959a2a-aa25-409e-86b7-473aa7089f51 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b/ips" status: 200 len: 147 microversion: 2.1 time: 0.254044 Jun 17 11:46:49.727792 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 356/706] 10.222.0.45 () {58 vars in 1247 bytes} [Fri Jun 17 11:46:49 2022] GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b/ips => generated 147 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:46:49.790281 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-bca321ca-80e9-42e2-b4a3-781955f16544 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:49.790911 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-bca321ca-80e9-42e2-b4a3-781955f16544 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:49.798593 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bca321ca-80e9-42e2-b4a3-781955f16544 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:49.799052 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bca321ca-80e9-42e2-b4a3-781955f16544 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:49.799875 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bca321ca-80e9-42e2-b4a3-781955f16544 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:49.800313 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bca321ca-80e9-42e2-b4a3-781955f16544 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:49.972831 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-bca321ca-80e9-42e2-b4a3-781955f16544 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:49.983296 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-bca321ca-80e9-42e2-b4a3-781955f16544 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1754 microversion: 2.1 time: 0.198701 Jun 17 11:46:49.984066 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 351/707] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:49 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1754 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:51.002351 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6805870a-2594-4248-9b4b-1e59fd728d89 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:51.003020 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-6805870a-2594-4248-9b4b-1e59fd728d89 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:51.009547 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6805870a-2594-4248-9b4b-1e59fd728d89 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:51.009995 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6805870a-2594-4248-9b4b-1e59fd728d89 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:51.010756 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6805870a-2594-4248-9b4b-1e59fd728d89 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:51.011194 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6805870a-2594-4248-9b4b-1e59fd728d89 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:51.160864 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6805870a-2594-4248-9b4b-1e59fd728d89 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:51.169173 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-6805870a-2594-4248-9b4b-1e59fd728d89 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1754 microversion: 2.1 time: 0.172379 Jun 17 11:46:51.169738 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 357/708] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:50 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:51.645620 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b8c6011b-2ef6-4707-8903-8f241fa93b41 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c154693-2e0a-4381-b1d8-991487530f11"}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:46:51.646727 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b8c6011b-2ef6-4707-8903-8f241fa93b41 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:51.653224 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b8c6011b-2ef6-4707-8903-8f241fa93b41 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:51.653694 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b8c6011b-2ef6-4707-8903-8f241fa93b41 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:51.654460 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b8c6011b-2ef6-4707-8903-8f241fa93b41 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:51.654898 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b8c6011b-2ef6-4707-8903-8f241fa93b41 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:52.186324 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-432a4fc5-3603-47f7-a18e-fd3b7b9a8f5d tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:52.187062 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-432a4fc5-3603-47f7-a18e-fd3b7b9a8f5d tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:52.194553 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-432a4fc5-3603-47f7-a18e-fd3b7b9a8f5d tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:52.195010 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-432a4fc5-3603-47f7-a18e-fd3b7b9a8f5d tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:52.195840 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-432a4fc5-3603-47f7-a18e-fd3b7b9a8f5d tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:52.196273 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-432a4fc5-3603-47f7-a18e-fd3b7b9a8f5d tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:52.370056 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-432a4fc5-3603-47f7-a18e-fd3b7b9a8f5d tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:52.379204 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-432a4fc5-3603-47f7-a18e-fd3b7b9a8f5d tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1754 microversion: 2.1 time: 0.196868 Jun 17 11:46:52.379829 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 358/709] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:52 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1754 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:46:52.526845 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b8c6011b-2ef6-4707-8903-8f241fa93b41 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "POST /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.884992 Jun 17 11:46:52.527532 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 352/710] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jun 17 11:46:51 2022] POST /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b/os-volume_attachments => generated 194 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:46:52.822652 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4a4bde60-56bd-47ea-92a9-6014e1aba104 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:52.823137 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4a4bde60-56bd-47ea-92a9-6014e1aba104 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:52.829774 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4a4bde60-56bd-47ea-92a9-6014e1aba104 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:52.833223 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4a4bde60-56bd-47ea-92a9-6014e1aba104 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:52.833223 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4a4bde60-56bd-47ea-92a9-6014e1aba104 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:52.833223 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4a4bde60-56bd-47ea-92a9-6014e1aba104 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:52.860407 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4a4bde60-56bd-47ea-92a9-6014e1aba104 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d/ips" status: 200 len: 152 microversion: 2.20 time: 0.161178 Jun 17 11:46:52.861668 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 359/711] 10.222.0.45 () {60 vars in 1288 bytes} [Fri Jun 17 11:46:52 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d/ips => generated 152 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 11:46:53.401826 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b1719b47-2f97-4e5e-a15c-177b6e2e0ee9 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:53.402550 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b1719b47-2f97-4e5e-a15c-177b6e2e0ee9 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:53.410041 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b1719b47-2f97-4e5e-a15c-177b6e2e0ee9 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:53.410467 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b1719b47-2f97-4e5e-a15c-177b6e2e0ee9 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:53.411261 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b1719b47-2f97-4e5e-a15c-177b6e2e0ee9 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:53.411720 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b1719b47-2f97-4e5e-a15c-177b6e2e0ee9 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:53.623511 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b1719b47-2f97-4e5e-a15c-177b6e2e0ee9 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:53.657880 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b1719b47-2f97-4e5e-a15c-177b6e2e0ee9 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1754 microversion: 2.1 time: 0.262985 Jun 17 11:46:53.659440 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 353/712] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:53 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1754 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:54.688984 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2dad450b-808c-412d-a2cb-ba5a9b3de24e tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:54.690169 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2dad450b-808c-412d-a2cb-ba5a9b3de24e tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:54.699203 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2dad450b-808c-412d-a2cb-ba5a9b3de24e tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:54.699203 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2dad450b-808c-412d-a2cb-ba5a9b3de24e tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:54.700211 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2dad450b-808c-412d-a2cb-ba5a9b3de24e tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:54.700726 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2dad450b-808c-412d-a2cb-ba5a9b3de24e tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:54.860374 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2dad450b-808c-412d-a2cb-ba5a9b3de24e tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:54.868672 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2dad450b-808c-412d-a2cb-ba5a9b3de24e tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1754 microversion: 2.1 time: 0.185850 Jun 17 11:46:54.869305 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 360/713] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:54 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1754 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:46:55.888140 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3bddafd8-4530-4d5e-bb69-4e6c57bd7cd1 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:55.889158 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-3bddafd8-4530-4d5e-bb69-4e6c57bd7cd1 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:55.898319 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3bddafd8-4530-4d5e-bb69-4e6c57bd7cd1 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:55.898905 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3bddafd8-4530-4d5e-bb69-4e6c57bd7cd1 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:55.899997 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3bddafd8-4530-4d5e-bb69-4e6c57bd7cd1 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:55.900534 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3bddafd8-4530-4d5e-bb69-4e6c57bd7cd1 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:55.939380 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-be5b3d73-674f-4b43-a2a8-57cb33539601 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:46:55.941002 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-be5b3d73-674f-4b43-a2a8-57cb33539601 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:55.947680 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-be5b3d73-674f-4b43-a2a8-57cb33539601 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:55.948167 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-be5b3d73-674f-4b43-a2a8-57cb33539601 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:55.949020 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-be5b3d73-674f-4b43-a2a8-57cb33539601 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:55.949458 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-be5b3d73-674f-4b43-a2a8-57cb33539601 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:55.977569 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-be5b3d73-674f-4b43-a2a8-57cb33539601 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lazy-loading 'flavor' on Instance uuid f4eb9c8c-b733-475e-b69e-279e9295ac4d {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:46:56.054603 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3bddafd8-4530-4d5e-bb69-4e6c57bd7cd1 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:56.063344 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-3bddafd8-4530-4d5e-bb69-4e6c57bd7cd1 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1754 microversion: 2.1 time: 0.179914 Jun 17 11:46:56.063954 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 354/714] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:55 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1754 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:46:56.535780 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-be5b3d73-674f-4b43-a2a8-57cb33539601 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "POST /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d/action" status: 202 len: 0 microversion: 2.20 time: 0.601619 Jun 17 11:46:56.537303 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 361/715] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jun 17 11:46:55 2022] POST /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d/action => generated 0 bytes in 603 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 17 11:46:56.545996 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-57a555db-0d7d-4d5c-9f82-b0dff4fbd884 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:56.548587 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-57a555db-0d7d-4d5c-9f82-b0dff4fbd884 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:56.555189 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-57a555db-0d7d-4d5c-9f82-b0dff4fbd884 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:56.555683 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-57a555db-0d7d-4d5c-9f82-b0dff4fbd884 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:56.556475 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-57a555db-0d7d-4d5c-9f82-b0dff4fbd884 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:56.556989 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-57a555db-0d7d-4d5c-9f82-b0dff4fbd884 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:56.703815 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-57a555db-0d7d-4d5c-9f82-b0dff4fbd884 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:56.712695 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-57a555db-0d7d-4d5c-9f82-b0dff4fbd884 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:56.714257 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-57a555db-0d7d-4d5c-9f82-b0dff4fbd884 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:56.715501 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-57a555db-0d7d-4d5c-9f82-b0dff4fbd884 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1723 microversion: 2.20 time: 0.174313 Jun 17 11:46:56.716074 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 355/716] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:46:56 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:46:57.081658 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-edc69575-caea-420e-a920-fdda5516d8f2 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:57.082360 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-edc69575-caea-420e-a920-fdda5516d8f2 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:57.088747 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-edc69575-caea-420e-a920-fdda5516d8f2 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:57.089193 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-edc69575-caea-420e-a920-fdda5516d8f2 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:57.090207 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-edc69575-caea-420e-a920-fdda5516d8f2 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:57.090648 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-edc69575-caea-420e-a920-fdda5516d8f2 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:57.244881 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-edc69575-caea-420e-a920-fdda5516d8f2 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:57.254740 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-edc69575-caea-420e-a920-fdda5516d8f2 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1754 microversion: 2.1 time: 0.178195 Jun 17 11:46:57.255315 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 362/717] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:57 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1754 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:57.811508 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-9e60a6aa-2f1e-4649-892c-98ab6462eae2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:57.811508 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-9e60a6aa-2f1e-4649-892c-98ab6462eae2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:57.811508 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9e60a6aa-2f1e-4649-892c-98ab6462eae2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:57.811508 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9e60a6aa-2f1e-4649-892c-98ab6462eae2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:57.812188 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9e60a6aa-2f1e-4649-892c-98ab6462eae2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:57.812188 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9e60a6aa-2f1e-4649-892c-98ab6462eae2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:57.886605 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-9e60a6aa-2f1e-4649-892c-98ab6462eae2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:57.896831 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-9e60a6aa-2f1e-4649-892c-98ab6462eae2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:57.898347 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-9e60a6aa-2f1e-4649-892c-98ab6462eae2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:57.899578 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-9e60a6aa-2f1e-4649-892c-98ab6462eae2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1723 microversion: 2.20 time: 0.169135 Jun 17 11:46:57.900163 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 356/718] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:46:57 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:46:58.272654 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-d561b370-eccc-4c5b-b8a0-f8f91ed0c582 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:58.273262 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-d561b370-eccc-4c5b-b8a0-f8f91ed0c582 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:58.280505 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d561b370-eccc-4c5b-b8a0-f8f91ed0c582 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:58.280957 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d561b370-eccc-4c5b-b8a0-f8f91ed0c582 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:58.281791 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d561b370-eccc-4c5b-b8a0-f8f91ed0c582 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:58.282223 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d561b370-eccc-4c5b-b8a0-f8f91ed0c582 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:58.475992 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-d561b370-eccc-4c5b-b8a0-f8f91ed0c582 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:58.485507 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-d561b370-eccc-4c5b-b8a0-f8f91ed0c582 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1754 microversion: 2.1 time: 0.216324 Jun 17 11:46:58.486102 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 363/719] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:58 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1754 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:46:58.920394 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-bbb60d62-e678-4103-8342-953ff73d92d3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:58.922025 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-bbb60d62-e678-4103-8342-953ff73d92d3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:58.936967 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bbb60d62-e678-4103-8342-953ff73d92d3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:58.938254 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bbb60d62-e678-4103-8342-953ff73d92d3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:58.939815 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bbb60d62-e678-4103-8342-953ff73d92d3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:58.940898 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bbb60d62-e678-4103-8342-953ff73d92d3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:59.098664 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-bbb60d62-e678-4103-8342-953ff73d92d3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:59.106670 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-bbb60d62-e678-4103-8342-953ff73d92d3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:59.108211 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-bbb60d62-e678-4103-8342-953ff73d92d3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:59.109389 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-bbb60d62-e678-4103-8342-953ff73d92d3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1723 microversion: 2.20 time: 0.195026 Jun 17 11:46:59.110596 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 357/720] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:46:58 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:46:59.504518 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9094ef45-7232-46bc-b129-c94bcb8f10bf tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:46:59.505147 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9094ef45-7232-46bc-b129-c94bcb8f10bf tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:46:59.511680 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9094ef45-7232-46bc-b129-c94bcb8f10bf tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:59.512130 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9094ef45-7232-46bc-b129-c94bcb8f10bf tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:59.512919 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9094ef45-7232-46bc-b129-c94bcb8f10bf tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:46:59.513604 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9094ef45-7232-46bc-b129-c94bcb8f10bf tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:46:59.684493 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9094ef45-7232-46bc-b129-c94bcb8f10bf tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:46:59.692854 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9094ef45-7232-46bc-b129-c94bcb8f10bf tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1754 microversion: 2.1 time: 0.194088 Jun 17 11:46:59.693419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 364/721] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:46:59 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1754 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:47:00.128809 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ac451cfa-2749-409a-a4de-fa0aa26e3a19 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:00.129434 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ac451cfa-2749-409a-a4de-fa0aa26e3a19 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:00.136675 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ac451cfa-2749-409a-a4de-fa0aa26e3a19 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:00.137123 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ac451cfa-2749-409a-a4de-fa0aa26e3a19 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:00.137943 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ac451cfa-2749-409a-a4de-fa0aa26e3a19 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:00.138357 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ac451cfa-2749-409a-a4de-fa0aa26e3a19 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:00.282416 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ac451cfa-2749-409a-a4de-fa0aa26e3a19 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:00.290894 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ac451cfa-2749-409a-a4de-fa0aa26e3a19 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:00.292369 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ac451cfa-2749-409a-a4de-fa0aa26e3a19 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:00.293535 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ac451cfa-2749-409a-a4de-fa0aa26e3a19 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1723 microversion: 2.20 time: 0.169335 Jun 17 11:47:00.294146 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 358/722] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:00 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:47:00.710372 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a6a32a0a-bd9d-4451-b069-81c1242df516 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:00.710965 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a6a32a0a-bd9d-4451-b069-81c1242df516 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:00.718206 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a6a32a0a-bd9d-4451-b069-81c1242df516 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:00.718646 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a6a32a0a-bd9d-4451-b069-81c1242df516 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:00.719430 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a6a32a0a-bd9d-4451-b069-81c1242df516 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:00.719893 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a6a32a0a-bd9d-4451-b069-81c1242df516 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:00.870996 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a6a32a0a-bd9d-4451-b069-81c1242df516 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:00.880710 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a6a32a0a-bd9d-4451-b069-81c1242df516 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1754 microversion: 2.1 time: 0.174115 Jun 17 11:47:00.881306 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 365/723] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:47:00 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:47:01.235582 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-def60e1b-3e97-46cb-b6f7-45c81c928b7a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c154693-2e0a-4381-b1d8-991487530f11"}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:47:01.238266 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-def60e1b-3e97-46cb-b6f7-45c81c928b7a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:01.245278 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-def60e1b-3e97-46cb-b6f7-45c81c928b7a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:01.245727 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-def60e1b-3e97-46cb-b6f7-45c81c928b7a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:01.246514 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-def60e1b-3e97-46cb-b6f7-45c81c928b7a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:01.246979 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-def60e1b-3e97-46cb-b6f7-45c81c928b7a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:01.313251 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-143bedfd-5dcb-4315-b05d-27f83bc89ce5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:01.314141 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-143bedfd-5dcb-4315-b05d-27f83bc89ce5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:01.320835 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-143bedfd-5dcb-4315-b05d-27f83bc89ce5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:01.325204 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-143bedfd-5dcb-4315-b05d-27f83bc89ce5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:01.325204 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-143bedfd-5dcb-4315-b05d-27f83bc89ce5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:01.325204 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-143bedfd-5dcb-4315-b05d-27f83bc89ce5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:01.347648 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-def60e1b-3e97-46cb-b6f7-45c81c928b7a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] HTTP exception thrown: Invalid volume: volume 9c154693-2e0a-4381-b1d8-991487530f11 is already attached to instances: 4b705046-ed66-4a09-9354-18ee01d1676b Jun 17 11:47:01.349411 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-def60e1b-3e97-46cb-b6f7-45c81c928b7a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Request method failure captured: Jun 17 11:47:01.349411 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: request: POST /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b/os-volume_attachments HTTP/1.1 Jun 17 11:47:01.349411 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept: application/json Jun 17 11:47:01.349411 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jun 17 11:47:01.349411 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Connection: close Jun 17 11:47:01.349411 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Length: 74 Jun 17 11:47:01.349411 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jun 17 11:47:01.349411 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Host: 10.222.0.45 Jun 17 11:47:01.349411 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jun 17 11:47:01.349411 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jun 17 11:47:01.349411 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABirGhbQZN58Mc4zyhUveG-Q-SFsZYiqbX0gxyltnPVCjSfEYNyfXfhfVCx5KdbK5qhE4EnaiOrUEMOKAhCCD_-tiKGRwJFUZvlEPvpBXY3_SY-UVihK6NaeFSNbrNpsHezSsj02ro8zcS2-cKoHlRfS3nCqLWBYJ5x0JyaHmYJlkw7b68 Jun 17 11:47:01.349411 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jun 17 11:47:01.349411 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jun 17 11:47:01.349411 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jun 17 11:47:01.349411 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jun 17 11:47:01.349411 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jun 17 11:47:01.349411 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jun 17 11:47:01.349411 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Id: c58cf63264414f30a98161f6027daad0 Jun 17 11:47:01.349411 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:47:01.349411 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Role: member,reader Jun 17 11:47:01.349411 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Roles: member,reader Jun 17 11:47:01.350987 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c58cf63264414f30a98161f6027daad0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c58cf63264414f30a98161f6027daad0", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c58cf63264414f30a98161f6027daad0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c58cf63264414f30a98161f6027daad0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:47:01.350987 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:47:01.350987 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Id: c58cf63264414f30a98161f6027daad0 Jun 17 11:47:01.350987 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:47:01.350987 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User: tempest-AttachVolumeNegativeTest-1942846496-project Jun 17 11:47:01.350987 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jun 17 11:47:01.350987 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jun 17 11:47:01.350987 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Id: 2e58eacbbb9e41fdbbb13f5b39be782a Jun 17 11:47:01.350987 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-AttachVolumeNegativeTest-1942846496-project Jun 17 11:47:01.350987 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Jun 17 11:47:01.350987 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {"volumeAttachment": {"volumeId": "9c154693-2e0a-4381-b1d8-991487530f11"}} Jun 17 11:47:01.350987 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: method: > Jun 17 11:47:01.351977 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: exception: Invalid volume: volume 9c154693-2e0a-4381-b1d8-991487530f11 is already attached to instances: 4b705046-ed66-4a09-9354-18ee01d1676b Jun 17 11:47:01.351977 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: action_args: {'server_id': '4b705046-ed66-4a09-9354-18ee01d1676b', 'body': {'volumeAttachment': {'volumeId': '9c154693-2e0a-4381-b1d8-991487530f11'}}} Jun 17 11:47:01.351977 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:47:01.351977 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:47:01.351977 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 17 11:47:01.351977 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 17 11:47:01.351977 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 11:47:01.351977 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 11:47:01.351977 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 11:47:01.351977 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 11:47:01.351977 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 17 11:47:01.351977 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 17 11:47:01.351977 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 17 11:47:01.351977 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 17 11:47:01.351977 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9c154693-2e0a-4381-b1d8-991487530f11 is already attached to instances: 4b705046-ed66-4a09-9354-18ee01d1676b Jun 17 11:47:01.351977 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:47:01.351977 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:47:01.351977 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:47:01.351977 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:47:01.353427 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:47:01.353427 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:47:01.353427 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:47:01.353427 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:47:01.353427 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:47:01.353427 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:47:01.353427 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 11:47:01.353427 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 11:47:01.353427 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 11:47:01.353427 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 11:47:01.353427 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 11:47:01.353427 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 11:47:01.353427 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 17 11:47:01.353427 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 11:47:01.353427 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9c154693-2e0a-4381-b1d8-991487530f11 is already attached to instances: 4b705046-ed66-4a09-9354-18ee01d1676b Jun 17 11:47:01.353427 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:47:01.353427 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:47:01.353427 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:47:01.353427 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:47:01.353427 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:47:01.355391 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:47:01.355391 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:47:01.355391 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:47:01.355391 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9c154693-2e0a-4381-b1d8-991487530f11 is already attached to instances: 4b705046-ed66-4a09-9354-18ee01d1676b Jun 17 11:47:01.355391 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:47:01.355391 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-def60e1b-3e97-46cb-b6f7-45c81c928b7a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Returning 400 to user: Invalid volume: volume 9c154693-2e0a-4381-b1d8-991487530f11 is already attached to instances: 4b705046-ed66-4a09-9354-18ee01d1676b {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:47:01.355391 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-def60e1b-3e97-46cb-b6f7-45c81c928b7a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "POST /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.119992 Jun 17 11:47:01.355391 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 359/724] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jun 17 11:47:01 2022] POST /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b/os-volume_attachments => generated 174 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 11:47:01.423652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-7dbec621-4222-4923-8c8b-a20a3509e5b1 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:01.424201 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7dbec621-4222-4923-8c8b-a20a3509e5b1 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:01.430626 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7dbec621-4222-4923-8c8b-a20a3509e5b1 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:01.431499 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7dbec621-4222-4923-8c8b-a20a3509e5b1 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:01.432446 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7dbec621-4222-4923-8c8b-a20a3509e5b1 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:01.433060 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7dbec621-4222-4923-8c8b-a20a3509e5b1 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:01.521170 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-143bedfd-5dcb-4315-b05d-27f83bc89ce5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:01.525111 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-7dbec621-4222-4923-8c8b-a20a3509e5b1 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lazy-loading 'services' on Instance uuid 4b705046-ed66-4a09-9354-18ee01d1676b {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:47:01.529907 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-143bedfd-5dcb-4315-b05d-27f83bc89ce5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:01.531753 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-143bedfd-5dcb-4315-b05d-27f83bc89ce5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:01.534137 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-143bedfd-5dcb-4315-b05d-27f83bc89ce5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1723 microversion: 2.20 time: 0.224645 Jun 17 11:47:01.535091 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 366/725] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:01 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:47:01.757595 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-7dbec621-4222-4923-8c8b-a20a3509e5b1 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b/os-volume_attachments/9c154693-2e0a-4381-b1d8-991487530f11" status: 202 len: 0 microversion: 2.1 time: 0.337934 Jun 17 11:47:01.759830 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 360/726] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Jun 17 11:47:01 2022] DELETE /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b/os-volume_attachments/9c154693-2e0a-4381-b1d8-991487530f11 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 17 11:47:01.766497 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a6a64d84-cc57-4e48-8fa3-0085f2e42a98 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:01.768722 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a6a64d84-cc57-4e48-8fa3-0085f2e42a98 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:01.775145 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a6a64d84-cc57-4e48-8fa3-0085f2e42a98 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:01.775619 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a6a64d84-cc57-4e48-8fa3-0085f2e42a98 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:01.776405 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a6a64d84-cc57-4e48-8fa3-0085f2e42a98 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:01.776836 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a6a64d84-cc57-4e48-8fa3-0085f2e42a98 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:01.808049 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a6a64d84-cc57-4e48-8fa3-0085f2e42a98 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045401 Jun 17 11:47:01.808616 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 367/727] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 17 11:47:01 2022] GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:47:01.900095 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-cd71b5af-b9ca-41b0-92be-2de7e44f6d89 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:01.900830 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-cd71b5af-b9ca-41b0-92be-2de7e44f6d89 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:01.908216 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cd71b5af-b9ca-41b0-92be-2de7e44f6d89 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:01.908885 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cd71b5af-b9ca-41b0-92be-2de7e44f6d89 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:01.909718 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cd71b5af-b9ca-41b0-92be-2de7e44f6d89 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:01.910279 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cd71b5af-b9ca-41b0-92be-2de7e44f6d89 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:02.077290 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-cd71b5af-b9ca-41b0-92be-2de7e44f6d89 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:02.086009 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-cd71b5af-b9ca-41b0-92be-2de7e44f6d89 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1754 microversion: 2.1 time: 0.190997 Jun 17 11:47:02.086577 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 361/728] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:47:01 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1754 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:47:02.554056 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-818c536e-0277-4a1a-8e7b-2627bbfcd9f2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:02.554729 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-818c536e-0277-4a1a-8e7b-2627bbfcd9f2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:02.562208 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-818c536e-0277-4a1a-8e7b-2627bbfcd9f2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:02.562772 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-818c536e-0277-4a1a-8e7b-2627bbfcd9f2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:02.563484 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-818c536e-0277-4a1a-8e7b-2627bbfcd9f2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:02.563920 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-818c536e-0277-4a1a-8e7b-2627bbfcd9f2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:02.767222 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-818c536e-0277-4a1a-8e7b-2627bbfcd9f2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:02.777376 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-818c536e-0277-4a1a-8e7b-2627bbfcd9f2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:02.779166 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-818c536e-0277-4a1a-8e7b-2627bbfcd9f2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:02.780442 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-818c536e-0277-4a1a-8e7b-2627bbfcd9f2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1723 microversion: 2.20 time: 0.230779 Jun 17 11:47:02.781143 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 368/729] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:02 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:47:02.820523 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4df56f86-95c5-48ef-b987-ee9493742a26 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:02.823570 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4df56f86-95c5-48ef-b987-ee9493742a26 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:02.828563 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4df56f86-95c5-48ef-b987-ee9493742a26 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:02.829402 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4df56f86-95c5-48ef-b987-ee9493742a26 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:02.830528 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4df56f86-95c5-48ef-b987-ee9493742a26 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:02.831070 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4df56f86-95c5-48ef-b987-ee9493742a26 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:02.850136 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:47:02.865815 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4df56f86-95c5-48ef-b987-ee9493742a26 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049317 Jun 17 11:47:02.866406 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 362/730] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 17 11:47:02 2022] GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:47:03.104510 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f1d5cdcf-3e60-4299-8a16-b80ecf9c19ce tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:03.104510 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f1d5cdcf-3e60-4299-8a16-b80ecf9c19ce tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:03.109642 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f1d5cdcf-3e60-4299-8a16-b80ecf9c19ce tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:03.110099 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f1d5cdcf-3e60-4299-8a16-b80ecf9c19ce tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:03.110863 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f1d5cdcf-3e60-4299-8a16-b80ecf9c19ce tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:03.112004 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f1d5cdcf-3e60-4299-8a16-b80ecf9c19ce tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:03.280415 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f1d5cdcf-3e60-4299-8a16-b80ecf9c19ce tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:03.288809 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f1d5cdcf-3e60-4299-8a16-b80ecf9c19ce tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1754 microversion: 2.1 time: 0.189675 Jun 17 11:47:03.289386 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 369/731] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:47:03 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1754 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:47:03.802581 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c2ad2c30-5a80-4988-8581-71fca1758952 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:03.803327 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c2ad2c30-5a80-4988-8581-71fca1758952 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:03.810863 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c2ad2c30-5a80-4988-8581-71fca1758952 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:03.811327 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c2ad2c30-5a80-4988-8581-71fca1758952 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:03.812152 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c2ad2c30-5a80-4988-8581-71fca1758952 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:03.812596 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c2ad2c30-5a80-4988-8581-71fca1758952 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:03.879600 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f2a5bbad-c955-4b6e-b0c3-c8fba7fd50cc tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:03.880884 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f2a5bbad-c955-4b6e-b0c3-c8fba7fd50cc tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:03.888346 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f2a5bbad-c955-4b6e-b0c3-c8fba7fd50cc tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:03.888799 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f2a5bbad-c955-4b6e-b0c3-c8fba7fd50cc tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:03.889803 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f2a5bbad-c955-4b6e-b0c3-c8fba7fd50cc tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:03.890445 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f2a5bbad-c955-4b6e-b0c3-c8fba7fd50cc tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:03.895106 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:47:03.924052 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f2a5bbad-c955-4b6e-b0c3-c8fba7fd50cc tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049345 Jun 17 11:47:03.927425 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 370/732] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 17 11:47:03 2022] GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 17 11:47:03.972625 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c2ad2c30-5a80-4988-8581-71fca1758952 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:03.980939 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c2ad2c30-5a80-4988-8581-71fca1758952 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:03.982431 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c2ad2c30-5a80-4988-8581-71fca1758952 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:03.983616 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c2ad2c30-5a80-4988-8581-71fca1758952 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1723 microversion: 2.20 time: 0.186868 Jun 17 11:47:03.984182 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 363/733] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:03 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:47:03.987870 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-35a59c63-d9cf-409b-8679-d064f73349be tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:03.988460 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-35a59c63-d9cf-409b-8679-d064f73349be tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:03.994837 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-35a59c63-d9cf-409b-8679-d064f73349be tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:03.995278 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-35a59c63-d9cf-409b-8679-d064f73349be tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:03.996098 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-35a59c63-d9cf-409b-8679-d064f73349be tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:03.996528 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-35a59c63-d9cf-409b-8679-d064f73349be tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:04.025089 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-35a59c63-d9cf-409b-8679-d064f73349be tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Going to try to terminate instance {{(pid=124845) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 11:47:04.305641 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-cede9695-1664-499e-b3d9-15148ed35211 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:04.306259 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-cede9695-1664-499e-b3d9-15148ed35211 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:04.312646 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cede9695-1664-499e-b3d9-15148ed35211 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:04.313171 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cede9695-1664-499e-b3d9-15148ed35211 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:04.314553 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cede9695-1664-499e-b3d9-15148ed35211 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:04.315224 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cede9695-1664-499e-b3d9-15148ed35211 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:04.411568 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-35a59c63-d9cf-409b-8679-d064f73349be tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b" status: 204 len: 0 microversion: 2.1 time: 0.427130 Jun 17 11:47:04.412774 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 371/734] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 17 11:47:03 2022] DELETE /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 17 11:47:04.428414 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4494a461-10a1-4005-9193-a495af29fb36 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:04.429738 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4494a461-10a1-4005-9193-a495af29fb36 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:04.442550 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4494a461-10a1-4005-9193-a495af29fb36 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:04.443349 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4494a461-10a1-4005-9193-a495af29fb36 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:04.445212 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4494a461-10a1-4005-9193-a495af29fb36 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:04.445968 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4494a461-10a1-4005-9193-a495af29fb36 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:04.469451 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-cede9695-1664-499e-b3d9-15148ed35211 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:04.478239 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-cede9695-1664-499e-b3d9-15148ed35211 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1754 microversion: 2.1 time: 0.176450 Jun 17 11:47:04.478833 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 364/735] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:47:04 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1754 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:47:04.631800 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-4494a461-10a1-4005-9193-a495af29fb36 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:04.639499 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4494a461-10a1-4005-9193-a495af29fb36 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b" status: 200 len: 1677 microversion: 2.1 time: 0.219989 Jun 17 11:47:04.651099 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 372/736] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:47:04 2022] GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b => generated 1677 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:47:05.004450 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e822c799-ad98-44d2-8a91-cc5c1c5ecae1 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:05.005291 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e822c799-ad98-44d2-8a91-cc5c1c5ecae1 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:05.013015 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e822c799-ad98-44d2-8a91-cc5c1c5ecae1 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:05.013474 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e822c799-ad98-44d2-8a91-cc5c1c5ecae1 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:05.014267 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e822c799-ad98-44d2-8a91-cc5c1c5ecae1 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:05.014708 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e822c799-ad98-44d2-8a91-cc5c1c5ecae1 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:05.162672 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e822c799-ad98-44d2-8a91-cc5c1c5ecae1 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:05.171505 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e822c799-ad98-44d2-8a91-cc5c1c5ecae1 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:05.173069 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e822c799-ad98-44d2-8a91-cc5c1c5ecae1 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:05.174783 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e822c799-ad98-44d2-8a91-cc5c1c5ecae1 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1723 microversion: 2.20 time: 0.175647 Jun 17 11:47:05.175351 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 365/737] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:04 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:47:05.497849 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-1481b842-045a-4c8c-8ef6-62a8e967a3b0 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:05.498685 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-1481b842-045a-4c8c-8ef6-62a8e967a3b0 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:05.510024 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1481b842-045a-4c8c-8ef6-62a8e967a3b0 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:05.510472 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1481b842-045a-4c8c-8ef6-62a8e967a3b0 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:05.511240 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1481b842-045a-4c8c-8ef6-62a8e967a3b0 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:05.511709 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1481b842-045a-4c8c-8ef6-62a8e967a3b0 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:05.659810 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-926da4e1-e0fc-4d5b-bbd3-020c27f34b32 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:05.660530 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-926da4e1-e0fc-4d5b-bbd3-020c27f34b32 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:05.668172 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-926da4e1-e0fc-4d5b-bbd3-020c27f34b32 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:05.669118 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-926da4e1-e0fc-4d5b-bbd3-020c27f34b32 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:05.669545 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-926da4e1-e0fc-4d5b-bbd3-020c27f34b32 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:05.670301 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-926da4e1-e0fc-4d5b-bbd3-020c27f34b32 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:05.674406 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-1481b842-045a-4c8c-8ef6-62a8e967a3b0 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:05.683869 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-1481b842-045a-4c8c-8ef6-62a8e967a3b0 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1757 microversion: 2.1 time: 0.190624 Jun 17 11:47:05.684454 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 373/738] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:47:05 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1757 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:47:05.825132 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-926da4e1-e0fc-4d5b-bbd3-020c27f34b32 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:05.834405 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-926da4e1-e0fc-4d5b-bbd3-020c27f34b32 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b" status: 200 len: 1677 microversion: 2.1 time: 0.179496 Jun 17 11:47:05.835004 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 366/739] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:47:05 2022] GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:47:06.193607 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-290171db-f047-4376-a9cc-80c2451b531f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:06.194447 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-290171db-f047-4376-a9cc-80c2451b531f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:06.201457 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-290171db-f047-4376-a9cc-80c2451b531f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:06.201967 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-290171db-f047-4376-a9cc-80c2451b531f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:06.203330 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-290171db-f047-4376-a9cc-80c2451b531f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:06.204163 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-290171db-f047-4376-a9cc-80c2451b531f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:06.396465 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-290171db-f047-4376-a9cc-80c2451b531f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:06.406215 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-290171db-f047-4376-a9cc-80c2451b531f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:06.408078 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-290171db-f047-4376-a9cc-80c2451b531f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:06.409548 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-290171db-f047-4376-a9cc-80c2451b531f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1723 microversion: 2.20 time: 0.220332 Jun 17 11:47:06.410234 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 374/740] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:06 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:47:06.853419 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b00cc5bf-29b2-436d-b0fa-43c1bde57266 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:06.854235 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b00cc5bf-29b2-436d-b0fa-43c1bde57266 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:06.860870 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b00cc5bf-29b2-436d-b0fa-43c1bde57266 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:06.862045 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b00cc5bf-29b2-436d-b0fa-43c1bde57266 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:06.862835 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b00cc5bf-29b2-436d-b0fa-43c1bde57266 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:06.863264 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b00cc5bf-29b2-436d-b0fa-43c1bde57266 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:07.108280 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b00cc5bf-29b2-436d-b0fa-43c1bde57266 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:07.116885 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b00cc5bf-29b2-436d-b0fa-43c1bde57266 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b" status: 200 len: 1677 microversion: 2.1 time: 0.268716 Jun 17 11:47:07.117478 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 367/741] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:47:06 2022] GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b => generated 1677 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:47:07.437025 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-69715cae-2d52-4165-b485-dda93d007265 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:07.438268 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-69715cae-2d52-4165-b485-dda93d007265 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:07.446902 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-69715cae-2d52-4165-b485-dda93d007265 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:07.450327 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-69715cae-2d52-4165-b485-dda93d007265 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:07.450327 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-69715cae-2d52-4165-b485-dda93d007265 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:07.450327 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-69715cae-2d52-4165-b485-dda93d007265 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:07.683836 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-69715cae-2d52-4165-b485-dda93d007265 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:07.700138 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-69715cae-2d52-4165-b485-dda93d007265 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:07.703153 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-69715cae-2d52-4165-b485-dda93d007265 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:07.706607 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-69715cae-2d52-4165-b485-dda93d007265 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1723 microversion: 2.20 time: 0.273170 Jun 17 11:47:07.708053 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 375/742] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:07 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1723 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:47:07.757026 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-79db5c58-f0d5-4f0a-85aa-27173f3cbe94 req-2fdf6236-bbbd-465a-a7c6-5f2e739afc99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b705046-ed66-4a09-9354-18ee01d1676b", "name": "network-vif-deleted", "tag": "59a1be8f-e417-465c-8536-98f4405514f7"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:47:07.767329 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-79db5c58-f0d5-4f0a-85aa-27173f3cbe94 req-2fdf6236-bbbd-465a-a7c6-5f2e739afc99 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:07.768719 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-79db5c58-f0d5-4f0a-85aa-27173f3cbe94 req-2fdf6236-bbbd-465a-a7c6-5f2e739afc99 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:07.784045 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-79db5c58-f0d5-4f0a-85aa-27173f3cbe94 req-2fdf6236-bbbd-465a-a7c6-5f2e739afc99 service nova] Creating event network-vif-deleted:59a1be8f-e417-465c-8536-98f4405514f7 for instance 4b705046-ed66-4a09-9354-18ee01d1676b on hv-cinder-83716 Jun 17 11:47:07.791500 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-79db5c58-f0d5-4f0a-85aa-27173f3cbe94 req-2fdf6236-bbbd-465a-a7c6-5f2e739afc99 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037312 Jun 17 11:47:07.797299 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 368/743] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:47:08.134449 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9c99acb4-fdaf-48a4-bd8d-f1dbade8bdea tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:08.135073 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9c99acb4-fdaf-48a4-bd8d-f1dbade8bdea tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:08.141328 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9c99acb4-fdaf-48a4-bd8d-f1dbade8bdea tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:08.141777 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9c99acb4-fdaf-48a4-bd8d-f1dbade8bdea tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:08.142571 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9c99acb4-fdaf-48a4-bd8d-f1dbade8bdea tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:08.143007 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9c99acb4-fdaf-48a4-bd8d-f1dbade8bdea tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:08.211030 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9c99acb4-fdaf-48a4-bd8d-f1dbade8bdea tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:08.219668 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9c99acb4-fdaf-48a4-bd8d-f1dbade8bdea tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b" status: 200 len: 1325 microversion: 2.1 time: 0.089219 Jun 17 11:47:08.220804 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 376/744] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:47:08 2022] GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b => generated 1325 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:47:08.727732 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-43f3614a-df6e-42c3-b5e7-cf530e8d489d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:08.728518 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-43f3614a-df6e-42c3-b5e7-cf530e8d489d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:08.735201 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-43f3614a-df6e-42c3-b5e7-cf530e8d489d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:08.735675 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-43f3614a-df6e-42c3-b5e7-cf530e8d489d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:08.737337 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-43f3614a-df6e-42c3-b5e7-cf530e8d489d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:08.737774 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-43f3614a-df6e-42c3-b5e7-cf530e8d489d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:08.895735 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-43f3614a-df6e-42c3-b5e7-cf530e8d489d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:08.904568 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-43f3614a-df6e-42c3-b5e7-cf530e8d489d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:08.906189 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-43f3614a-df6e-42c3-b5e7-cf530e8d489d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:08.907348 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-43f3614a-df6e-42c3-b5e7-cf530e8d489d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1723 microversion: 2.20 time: 0.184646 Jun 17 11:47:08.908611 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 369/745] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:08 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:47:09.238627 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-bee77206-28d0-48c5-ba12-bd5be5bcf1e7 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:09.239305 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-bee77206-28d0-48c5-ba12-bd5be5bcf1e7 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:09.246050 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bee77206-28d0-48c5-ba12-bd5be5bcf1e7 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:09.246524 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bee77206-28d0-48c5-ba12-bd5be5bcf1e7 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:09.247295 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bee77206-28d0-48c5-ba12-bd5be5bcf1e7 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:09.247753 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bee77206-28d0-48c5-ba12-bd5be5bcf1e7 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:09.262128 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-bee77206-28d0-48c5-ba12-bd5be5bcf1e7 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] HTTP exception thrown: Instance 4b705046-ed66-4a09-9354-18ee01d1676b could not be found. Jun 17 11:47:09.263805 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-bee77206-28d0-48c5-ba12-bd5be5bcf1e7 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Request method failure captured: Jun 17 11:47:09.263805 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b HTTP/1.1 Jun 17 11:47:09.263805 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jun 17 11:47:09.263805 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jun 17 11:47:09.263805 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Connection: close Jun 17 11:47:09.263805 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jun 17 11:47:09.263805 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jun 17 11:47:09.263805 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.45 Jun 17 11:47:09.263805 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jun 17 11:47:09.263805 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jun 17 11:47:09.263805 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABirGhbQZN58Mc4zyhUveG-Q-SFsZYiqbX0gxyltnPVCjSfEYNyfXfhfVCx5KdbK5qhE4EnaiOrUEMOKAhCCD_-tiKGRwJFUZvlEPvpBXY3_SY-UVihK6NaeFSNbrNpsHezSsj02ro8zcS2-cKoHlRfS3nCqLWBYJ5x0JyaHmYJlkw7b68 Jun 17 11:47:09.263805 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jun 17 11:47:09.263805 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jun 17 11:47:09.263805 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jun 17 11:47:09.263805 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jun 17 11:47:09.263805 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jun 17 11:47:09.263805 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jun 17 11:47:09.263805 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Id: c58cf63264414f30a98161f6027daad0 Jun 17 11:47:09.263805 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:47:09.263805 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jun 17 11:47:09.263805 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jun 17 11:47:09.266199 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c58cf63264414f30a98161f6027daad0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c58cf63264414f30a98161f6027daad0", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c58cf63264414f30a98161f6027daad0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c58cf63264414f30a98161f6027daad0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:47:09.266199 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:47:09.266199 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: c58cf63264414f30a98161f6027daad0 Jun 17 11:47:09.266199 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:47:09.266199 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User: tempest-AttachVolumeNegativeTest-1942846496-project Jun 17 11:47:09.266199 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jun 17 11:47:09.266199 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jun 17 11:47:09.266199 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Id: 2e58eacbbb9e41fdbbb13f5b39be782a Jun 17 11:47:09.266199 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-AttachVolumeNegativeTest-1942846496-project Jun 17 11:47:09.266199 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: method: > Jun 17 11:47:09.266199 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: exception: Instance 4b705046-ed66-4a09-9354-18ee01d1676b could not be found. Jun 17 11:47:09.266199 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: action_args: {'id': '4b705046-ed66-4a09-9354-18ee01d1676b'} Jun 17 11:47:09.267959 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:47:09.267959 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:47:09.267959 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:47:09.267959 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:47:09.267959 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:47:09.267959 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:47:09.267959 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:47:09.267959 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:47:09.267959 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:47:09.267959 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:47:09.267959 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b705046-ed66-4a09-9354-18ee01d1676b could not be found. Jun 17 11:47:09.267959 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:47:09.267959 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:47:09.267959 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:47:09.267959 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:47:09.267959 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:47:09.267959 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:47:09.267959 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:47:09.267959 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:47:09.267959 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:47:09.270114 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:47:09.270114 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 11:47:09.270114 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 11:47:09.270114 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:47:09.270114 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:47:09.270114 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:47:09.270114 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:47:09.270114 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b705046-ed66-4a09-9354-18ee01d1676b could not be found. Jun 17 11:47:09.270114 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:47:09.270114 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:47:09.270114 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:47:09.270114 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:47:09.270114 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:47:09.270114 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:47:09.270114 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:47:09.270114 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:47:09.270114 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b705046-ed66-4a09-9354-18ee01d1676b could not be found. Jun 17 11:47:09.270114 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:47:09.273118 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-bee77206-28d0-48c5-ba12-bd5be5bcf1e7 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Returning 404 to user: Instance 4b705046-ed66-4a09-9354-18ee01d1676b could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:47:09.273118 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-bee77206-28d0-48c5-ba12-bd5be5bcf1e7 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b" status: 404 len: 111 microversion: 2.1 time: 0.031876 Jun 17 11:47:09.273118 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 377/746] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:47:09 2022] GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:47:09.281262 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2e33ee44-5058-4f57-9167-e32280264b31 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '.version_select at 0x7f9c767869d0>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:09.377765 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2e33ee44-5058-4f57-9167-e32280264b31 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-695579830" status: 202 len: 0 microversion: 2.1 time: 0.106553 Jun 17 11:47:09.381713 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 370/747] 10.222.0.45 () {58 vars in 1217 bytes} [Fri Jun 17 11:47:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-695579830 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 11:47:09.927723 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c3b2958b-4796-4758-b2d8-696560541e6c tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:09.928499 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c3b2958b-4796-4758-b2d8-696560541e6c tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:09.935050 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c3b2958b-4796-4758-b2d8-696560541e6c tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:09.935518 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c3b2958b-4796-4758-b2d8-696560541e6c tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:09.936293 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c3b2958b-4796-4758-b2d8-696560541e6c tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:09.936724 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c3b2958b-4796-4758-b2d8-696560541e6c tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:10.137587 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c3b2958b-4796-4758-b2d8-696560541e6c tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:10.148698 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c3b2958b-4796-4758-b2d8-696560541e6c tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:10.150811 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c3b2958b-4796-4758-b2d8-696560541e6c tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:10.152391 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c3b2958b-4796-4758-b2d8-696560541e6c tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1723 microversion: 2.20 time: 0.230008 Jun 17 11:47:10.152963 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 378/748] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:09 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:47:10.345982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a4ed6c99-9171-4a15-80aa-941896a383cb tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Action: 'create', calling method: .version_select at 0x7f9c76742820>, body: {"keypair": {"name": "tempest-keypair-1047941471", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIirPP0x0Kz9vrgWPGUVIEjAe7knZ+KptV/4z9jvAwUbIkURzYtUu/ugiGgQfPpVqvbvu2OA3QgfsViit02s3u0q60H674UqziJwVcirfVNQhmDiEU+9W34/yAW4dXnC+g=="}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:47:10.362543 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-a4ed6c99-9171-4a15-80aa-941896a383cb tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Getting quotas for project c58cf63264414f30a98161f6027daad0. Resources: {'key_pairs'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 11:47:10.366772 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-a4ed6c99-9171-4a15-80aa-941896a383cb tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Getting quotas for user 2e58eacbbb9e41fdbbb13f5b39be782a and project c58cf63264414f30a98161f6027daad0. Resources: {'key_pairs'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 11:47:10.469854 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a4ed6c99-9171-4a15-80aa-941896a383cb tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.128290 Jun 17 11:47:10.470904 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 371/749] 10.222.0.45 () {60 vars in 1158 bytes} [Fri Jun 17 11:47:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:47:11.170242 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-63720ae1-e117-439d-b87c-fa0afd7bd77d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:11.171160 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-63720ae1-e117-439d-b87c-fa0afd7bd77d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:11.178900 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-63720ae1-e117-439d-b87c-fa0afd7bd77d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:11.179343 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-63720ae1-e117-439d-b87c-fa0afd7bd77d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:11.180180 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-63720ae1-e117-439d-b87c-fa0afd7bd77d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:11.181886 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-63720ae1-e117-439d-b87c-fa0afd7bd77d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:11.393597 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-63720ae1-e117-439d-b87c-fa0afd7bd77d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:11.404628 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-63720ae1-e117-439d-b87c-fa0afd7bd77d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:11.406240 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-63720ae1-e117-439d-b87c-fa0afd7bd77d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:11.407466 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-63720ae1-e117-439d-b87c-fa0afd7bd77d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1723 microversion: 2.20 time: 0.241190 Jun 17 11:47:11.409052 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 379/750] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:11 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:47:12.439753 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-107f8124-c0db-4289-b668-71c711680ac5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:12.441655 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-107f8124-c0db-4289-b668-71c711680ac5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:12.452064 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-107f8124-c0db-4289-b668-71c711680ac5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:12.452749 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-107f8124-c0db-4289-b668-71c711680ac5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:12.453656 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-107f8124-c0db-4289-b668-71c711680ac5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:12.454180 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-107f8124-c0db-4289-b668-71c711680ac5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:12.614388 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-107f8124-c0db-4289-b668-71c711680ac5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:12.627943 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-107f8124-c0db-4289-b668-71c711680ac5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:12.629921 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-107f8124-c0db-4289-b668-71c711680ac5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:12.631354 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-107f8124-c0db-4289-b668-71c711680ac5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1723 microversion: 2.20 time: 0.199677 Jun 17 11:47:12.635994 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 372/751] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:12 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:47:13.650355 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c61ec8e4-f6f3-41ee-b7d4-99b50faeb76e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:13.651687 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c61ec8e4-f6f3-41ee-b7d4-99b50faeb76e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:13.656129 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:47:13.672818 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c61ec8e4-f6f3-41ee-b7d4-99b50faeb76e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:13.673286 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c61ec8e4-f6f3-41ee-b7d4-99b50faeb76e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:13.675319 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-03354ef2-695f-4e13-ae7b-927322a60748 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1041059412", "imageRef": "272eb2b7-ddf0-433f-8be8-cdc13c01be77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "562be4fa-7f02-4e16-ab0e-484de596db99"}], "security_groups": [{"name": "tempest-securitygroup--1262497002"}], "key_name": "tempest-keypair-1047941471", "user_data": "}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:47:13.676828 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c61ec8e4-f6f3-41ee-b7d4-99b50faeb76e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:13.677269 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c61ec8e4-f6f3-41ee-b7d4-99b50faeb76e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:13.829438 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.network.neutron [None req-03354ef2-695f-4e13-ae7b-927322a60748 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] validate_networks() for [('562be4fa-7f02-4e16-ab0e-484de596db99', None, None, None, None, None)] {{(pid=124844) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 11:47:13.924332 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c61ec8e4-f6f3-41ee-b7d4-99b50faeb76e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:13.933192 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c61ec8e4-f6f3-41ee-b7d4-99b50faeb76e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:13.935009 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c61ec8e4-f6f3-41ee-b7d4-99b50faeb76e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:13.936312 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c61ec8e4-f6f3-41ee-b7d4-99b50faeb76e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1723 microversion: 2.20 time: 0.290082 Jun 17 11:47:13.936961 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 380/752] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:13 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:47:14.245866 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-03354ef2-695f-4e13-ae7b-927322a60748 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Flavor limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 11:47:14.246287 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-03354ef2-695f-4e13-ae7b-927322a60748 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Image limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 11:47:14.246760 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-03354ef2-695f-4e13-ae7b-927322a60748 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Flavor pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 11:47:14.247168 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-03354ef2-695f-4e13-ae7b-927322a60748 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Image pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 11:47:14.247607 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-03354ef2-695f-4e13-ae7b-927322a60748 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 11:47:14.257979 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-03354ef2-695f-4e13-ae7b-927322a60748 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:14.258420 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-03354ef2-695f-4e13-ae7b-927322a60748 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:14.259226 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-03354ef2-695f-4e13-ae7b-927322a60748 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:14.259694 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-03354ef2-695f-4e13-ae7b-927322a60748 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:14.277481 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-03354ef2-695f-4e13-ae7b-927322a60748 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Getting quotas for project c58cf63264414f30a98161f6027daad0. Resources: {'instances', 'ram', 'cores'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 11:47:14.281945 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-03354ef2-695f-4e13-ae7b-927322a60748 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Getting quotas for user 2e58eacbbb9e41fdbbb13f5b39be782a and project c58cf63264414f30a98161f6027daad0. Resources: {'instances', 'ram', 'cores'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 11:47:14.295175 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-03354ef2-695f-4e13-ae7b-927322a60748 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Going to run 1 instances... {{(pid=124844) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 11:47:14.297628 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-03354ef2-695f-4e13-ae7b-927322a60748 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 52cfb97a-c546-496a-9557-1663ada483b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='272eb2b7-ddf0-433f-8be8-cdc13c01be77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 11:47:14.440058 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-03354ef2-695f-4e13-ae7b-927322a60748 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.769999 Jun 17 11:47:14.440729 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 373/753] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 17 11:47:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 17 11:47:14.451141 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4eeb416f-3183-4267-989b-81766b04ee1e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:14.451787 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4eeb416f-3183-4267-989b-81766b04ee1e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 52cfb97a-c546-496a-9557-1663ada483b3] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:14.515275 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-4eeb416f-3183-4267-989b-81766b04ee1e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:14.541166 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4eeb416f-3183-4267-989b-81766b04ee1e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3" status: 200 len: 1242 microversion: 2.1 time: 0.077998 Jun 17 11:47:14.541166 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 381/754] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:47:14 2022] GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3 => generated 1242 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:47:14.955671 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-cff5aa6d-f67d-4edf-ad1f-6569aef441f7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:14.956514 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-cff5aa6d-f67d-4edf-ad1f-6569aef441f7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:14.963967 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cff5aa6d-f67d-4edf-ad1f-6569aef441f7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:14.964511 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cff5aa6d-f67d-4edf-ad1f-6569aef441f7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:14.965422 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cff5aa6d-f67d-4edf-ad1f-6569aef441f7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:14.965931 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cff5aa6d-f67d-4edf-ad1f-6569aef441f7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:15.127295 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-cff5aa6d-f67d-4edf-ad1f-6569aef441f7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:15.136154 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-cff5aa6d-f67d-4edf-ad1f-6569aef441f7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:15.137731 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-cff5aa6d-f67d-4edf-ad1f-6569aef441f7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:15.161817 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-cff5aa6d-f67d-4edf-ad1f-6569aef441f7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1723 microversion: 2.20 time: 0.188066 Jun 17 11:47:15.161817 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 374/755] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:14 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:47:15.542460 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-33926f70-279d-4570-bb8e-ba98c0acd601 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:15.543203 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-33926f70-279d-4570-bb8e-ba98c0acd601 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 52cfb97a-c546-496a-9557-1663ada483b3] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:15.606482 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-33926f70-279d-4570-bb8e-ba98c0acd601 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:15.620624 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-33926f70-279d-4570-bb8e-ba98c0acd601 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3" status: 200 len: 1242 microversion: 2.1 time: 0.081750 Jun 17 11:47:15.628682 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 382/756] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:47:15 2022] GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:47:16.073081 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f607d903-9983-4fa2-a269-669ceda68586 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:16.073641 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f607d903-9983-4fa2-a269-669ceda68586 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:16.081924 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f607d903-9983-4fa2-a269-669ceda68586 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:16.082380 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f607d903-9983-4fa2-a269-669ceda68586 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:16.083452 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f607d903-9983-4fa2-a269-669ceda68586 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:16.083893 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f607d903-9983-4fa2-a269-669ceda68586 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:16.110441 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f607d903-9983-4fa2-a269-669ceda68586 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892/ips" status: 200 len: 145 microversion: 2.1 time: 0.041312 Jun 17 11:47:16.111128 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 375/757] 10.222.0.45 () {58 vars in 1247 bytes} [Fri Jun 17 11:47:16 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:47:16.167047 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-36a58cdf-e2e5-43f2-aa8d-00569c5c1c4a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:16.167672 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-36a58cdf-e2e5-43f2-aa8d-00569c5c1c4a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:16.180961 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-36a58cdf-e2e5-43f2-aa8d-00569c5c1c4a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:16.180961 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-36a58cdf-e2e5-43f2-aa8d-00569c5c1c4a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:16.180961 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-36a58cdf-e2e5-43f2-aa8d-00569c5c1c4a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:16.180961 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-36a58cdf-e2e5-43f2-aa8d-00569c5c1c4a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:16.331910 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-36a58cdf-e2e5-43f2-aa8d-00569c5c1c4a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:16.340289 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-36a58cdf-e2e5-43f2-aa8d-00569c5c1c4a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:16.341824 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-36a58cdf-e2e5-43f2-aa8d-00569c5c1c4a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:16.343022 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-36a58cdf-e2e5-43f2-aa8d-00569c5c1c4a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1723 microversion: 2.20 time: 0.179831 Jun 17 11:47:16.343640 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 383/758] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:16 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:47:16.643920 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-7c552000-c449-4ed4-be5d-ebe4209f2986 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:16.644658 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7c552000-c449-4ed4-be5d-ebe4209f2986 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 52cfb97a-c546-496a-9557-1663ada483b3] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:16.651149 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7c552000-c449-4ed4-be5d-ebe4209f2986 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:16.652039 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7c552000-c449-4ed4-be5d-ebe4209f2986 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:16.652931 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7c552000-c449-4ed4-be5d-ebe4209f2986 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:16.653494 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7c552000-c449-4ed4-be5d-ebe4209f2986 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:16.722220 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7c552000-c449-4ed4-be5d-ebe4209f2986 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:16.729890 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-7c552000-c449-4ed4-be5d-ebe4209f2986 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3" status: 200 len: 1294 microversion: 2.1 time: 0.090690 Jun 17 11:47:16.730476 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 376/759] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:47:16 2022] GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3 => generated 1294 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:47:17.363179 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-d9f2f665-685a-42ea-98b6-cd9c89363a84 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:17.367889 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-d9f2f665-685a-42ea-98b6-cd9c89363a84 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:17.370768 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d9f2f665-685a-42ea-98b6-cd9c89363a84 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:17.371215 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d9f2f665-685a-42ea-98b6-cd9c89363a84 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:17.372028 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d9f2f665-685a-42ea-98b6-cd9c89363a84 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:17.372467 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d9f2f665-685a-42ea-98b6-cd9c89363a84 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:17.747400 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-69919876-cbac-4dd7-ab25-fe57749314d3 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:17.748262 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-69919876-cbac-4dd7-ab25-fe57749314d3 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 52cfb97a-c546-496a-9557-1663ada483b3] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:17.751092 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:47:17.756952 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-69919876-cbac-4dd7-ab25-fe57749314d3 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:17.757399 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-69919876-cbac-4dd7-ab25-fe57749314d3 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:17.758175 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-69919876-cbac-4dd7-ab25-fe57749314d3 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:17.758606 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-69919876-cbac-4dd7-ab25-fe57749314d3 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:17.898699 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-d9f2f665-685a-42ea-98b6-cd9c89363a84 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:17.907288 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-69919876-cbac-4dd7-ab25-fe57749314d3 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:17.915055 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-d9f2f665-685a-42ea-98b6-cd9c89363a84 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:17.918211 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-d9f2f665-685a-42ea-98b6-cd9c89363a84 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:17.923210 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-69919876-cbac-4dd7-ab25-fe57749314d3 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3" status: 200 len: 1302 microversion: 2.1 time: 0.179578 Jun 17 11:47:17.935867 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-d9f2f665-685a-42ea-98b6-cd9c89363a84 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1744 microversion: 2.20 time: 0.561124 Jun 17 11:47:17.936998 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 384/760] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:17 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1744 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:47:17.937183 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 377/761] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:47:17 2022] GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3 => generated 1302 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:47:18.000536 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-3d4de80a-1d62-42bb-b6a6-0ffa1d07c431 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c04a7e7e-9008-4580-bc50-ffe713d3bbbd"}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:47:18.001800 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-3d4de80a-1d62-42bb-b6a6-0ffa1d07c431 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:18.009130 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3d4de80a-1d62-42bb-b6a6-0ffa1d07c431 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:18.009715 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3d4de80a-1d62-42bb-b6a6-0ffa1d07c431 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:18.010561 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3d4de80a-1d62-42bb-b6a6-0ffa1d07c431 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:18.011082 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3d4de80a-1d62-42bb-b6a6-0ffa1d07c431 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:18.948063 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-45588c18-0bbd-4b9c-9000-5901bd566015 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:18.948690 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-45588c18-0bbd-4b9c-9000-5901bd566015 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 52cfb97a-c546-496a-9557-1663ada483b3] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:18.957089 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-45588c18-0bbd-4b9c-9000-5901bd566015 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:18.957678 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-45588c18-0bbd-4b9c-9000-5901bd566015 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:18.958529 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-45588c18-0bbd-4b9c-9000-5901bd566015 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:18.959034 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-45588c18-0bbd-4b9c-9000-5901bd566015 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:19.022547 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-3d4de80a-1d62-42bb-b6a6-0ffa1d07c431 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "POST /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.026156 Jun 17 11:47:19.023524 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 385/762] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jun 17 11:47:17 2022] POST /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892/os-volume_attachments => generated 194 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:47:19.049725 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-1e4d9eb4-cf39-4429-b84c-2f87e5e3ee1a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:19.050683 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-1e4d9eb4-cf39-4429-b84c-2f87e5e3ee1a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:19.057906 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1e4d9eb4-cf39-4429-b84c-2f87e5e3ee1a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:19.069478 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1e4d9eb4-cf39-4429-b84c-2f87e5e3ee1a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:19.069478 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1e4d9eb4-cf39-4429-b84c-2f87e5e3ee1a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:19.069478 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1e4d9eb4-cf39-4429-b84c-2f87e5e3ee1a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:19.099420 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:47:19.245587 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-45588c18-0bbd-4b9c-9000-5901bd566015 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:19.261187 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-45588c18-0bbd-4b9c-9000-5901bd566015 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3" status: 200 len: 1368 microversion: 2.1 time: 0.314679 Jun 17 11:47:19.261187 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 378/763] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:47:18 2022] GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3 => generated 1368 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:47:19.375103 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-1e4d9eb4-cf39-4429-b84c-2f87e5e3ee1a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:19.391204 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-1e4d9eb4-cf39-4429-b84c-2f87e5e3ee1a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:19.393411 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-1e4d9eb4-cf39-4429-b84c-2f87e5e3ee1a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:19.400324 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-1e4d9eb4-cf39-4429-b84c-2f87e5e3ee1a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1744 microversion: 2.20 time: 0.374411 Jun 17 11:47:19.402881 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 386/764] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:19 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1744 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:47:20.301063 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-61270f3a-fb04-4265-b001-6ebf46737d66 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:20.304699 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-76bd89d6-3e4a-427e-9dfa-f2dce75a91ac req-a50589ff-d334-4343-b2a4-c68fd73494b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52cfb97a-c546-496a-9557-1663ada483b3", "tag": "ec529d14-50c4-4d90-8fe1-d7b22fa82064"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:47:20.316157 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-61270f3a-fb04-4265-b001-6ebf46737d66 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 52cfb97a-c546-496a-9557-1663ada483b3] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:20.324428 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-76bd89d6-3e4a-427e-9dfa-f2dce75a91ac req-a50589ff-d334-4343-b2a4-c68fd73494b9 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:20.324909 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-76bd89d6-3e4a-427e-9dfa-f2dce75a91ac req-a50589ff-d334-4343-b2a4-c68fd73494b9 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:20.341805 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-61270f3a-fb04-4265-b001-6ebf46737d66 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:20.342587 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-61270f3a-fb04-4265-b001-6ebf46737d66 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:20.343996 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-61270f3a-fb04-4265-b001-6ebf46737d66 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:20.344771 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-61270f3a-fb04-4265-b001-6ebf46737d66 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:20.349748 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-76bd89d6-3e4a-427e-9dfa-f2dce75a91ac req-a50589ff-d334-4343-b2a4-c68fd73494b9 service nova] Creating event network-changed:ec529d14-50c4-4d90-8fe1-d7b22fa82064 for instance 52cfb97a-c546-496a-9557-1663ada483b3 on hv-cinder-83716 Jun 17 11:47:20.366427 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-76bd89d6-3e4a-427e-9dfa-f2dce75a91ac req-a50589ff-d334-4343-b2a4-c68fd73494b9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068185 Jun 17 11:47:20.368539 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 387/765] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:47:20.428155 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-20137c5c-9bad-494b-80d2-e6482dd00f3c tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:20.429759 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-20137c5c-9bad-494b-80d2-e6482dd00f3c tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:20.444530 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-20137c5c-9bad-494b-80d2-e6482dd00f3c tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:20.446428 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-20137c5c-9bad-494b-80d2-e6482dd00f3c tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:20.448092 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-20137c5c-9bad-494b-80d2-e6482dd00f3c tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:20.449340 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-20137c5c-9bad-494b-80d2-e6482dd00f3c tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:20.950607 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-61270f3a-fb04-4265-b001-6ebf46737d66 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:20.964487 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-61270f3a-fb04-4265-b001-6ebf46737d66 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3" status: 200 len: 1368 microversion: 2.1 time: 0.689675 Jun 17 11:47:20.965926 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 379/766] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:47:20 2022] GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3 => generated 1368 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:47:21.008862 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-20137c5c-9bad-494b-80d2-e6482dd00f3c tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:21.024934 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-20137c5c-9bad-494b-80d2-e6482dd00f3c tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:21.027883 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-20137c5c-9bad-494b-80d2-e6482dd00f3c tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:21.029320 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-20137c5c-9bad-494b-80d2-e6482dd00f3c tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1739 microversion: 2.20 time: 0.610813 Jun 17 11:47:21.033622 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 388/767] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:20 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1739 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:47:21.881871 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-1f92ab69-17bd-4b4b-8a6f-a74eb249e9cb req-b42372d1-35e1-4135-aab6-26c083b5d5e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4eb9c8c-b733-475e-b69e-279e9295ac4d", "name": "network-vif-plugged", "status": "completed", "tag": "f00e28a8-041d-4c99-8685-2e89673ad6b8"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:47:21.892645 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-1f92ab69-17bd-4b4b-8a6f-a74eb249e9cb req-b42372d1-35e1-4135-aab6-26c083b5d5e4 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:21.894118 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-1f92ab69-17bd-4b4b-8a6f-a74eb249e9cb req-b42372d1-35e1-4135-aab6-26c083b5d5e4 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:22.006554 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-1f92ab69-17bd-4b4b-8a6f-a74eb249e9cb req-b42372d1-35e1-4135-aab6-26c083b5d5e4 service nova] Creating event network-vif-plugged:f00e28a8-041d-4c99-8685-2e89673ad6b8 for instance f4eb9c8c-b733-475e-b69e-279e9295ac4d on hv-cinder-83716 Jun 17 11:47:22.007461 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8c8f3638-6f53-4b7a-9b5a-f74591a204cc tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:22.010353 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-8c8f3638-6f53-4b7a-9b5a-f74591a204cc tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 52cfb97a-c546-496a-9557-1663ada483b3] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:22.020370 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-1f92ab69-17bd-4b4b-8a6f-a74eb249e9cb req-b42372d1-35e1-4135-aab6-26c083b5d5e4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.506923 Jun 17 11:47:22.021977 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 380/768] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:47:22.033023 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8c8f3638-6f53-4b7a-9b5a-f74591a204cc tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:22.035051 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8c8f3638-6f53-4b7a-9b5a-f74591a204cc tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:22.040252 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8c8f3638-6f53-4b7a-9b5a-f74591a204cc tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:22.040996 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8c8f3638-6f53-4b7a-9b5a-f74591a204cc tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:22.061798 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-86acec1d-10e4-4d21-a67d-7b2fe9fa56b1 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:22.062596 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-86acec1d-10e4-4d21-a67d-7b2fe9fa56b1 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:22.072843 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-86acec1d-10e4-4d21-a67d-7b2fe9fa56b1 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:22.073646 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-86acec1d-10e4-4d21-a67d-7b2fe9fa56b1 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:22.074629 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-86acec1d-10e4-4d21-a67d-7b2fe9fa56b1 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:22.075249 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-86acec1d-10e4-4d21-a67d-7b2fe9fa56b1 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:22.365035 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-8c8f3638-6f53-4b7a-9b5a-f74591a204cc tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:22.374368 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-8c8f3638-6f53-4b7a-9b5a-f74591a204cc tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3" status: 200 len: 1368 microversion: 2.1 time: 0.382488 Jun 17 11:47:22.374973 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 389/769] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:47:21 2022] GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3 => generated 1368 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:47:22.396576 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-86acec1d-10e4-4d21-a67d-7b2fe9fa56b1 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:22.408465 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-86acec1d-10e4-4d21-a67d-7b2fe9fa56b1 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:22.410981 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-86acec1d-10e4-4d21-a67d-7b2fe9fa56b1 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:22.412550 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-86acec1d-10e4-4d21-a67d-7b2fe9fa56b1 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1739 microversion: 2.20 time: 0.356243 Jun 17 11:47:22.413591 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 381/770] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:22 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1739 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:47:23.393437 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4ece91f3-f51c-4627-a66f-effc829159b4 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:23.394195 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4ece91f3-f51c-4627-a66f-effc829159b4 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 52cfb97a-c546-496a-9557-1663ada483b3] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:23.401189 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4ece91f3-f51c-4627-a66f-effc829159b4 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:23.401935 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4ece91f3-f51c-4627-a66f-effc829159b4 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:23.402943 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4ece91f3-f51c-4627-a66f-effc829159b4 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:23.403616 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4ece91f3-f51c-4627-a66f-effc829159b4 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:23.435205 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ece88eb0-67f0-4919-892f-005ba510ca5b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:23.435871 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ece88eb0-67f0-4919-892f-005ba510ca5b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:23.446721 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ece88eb0-67f0-4919-892f-005ba510ca5b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:23.447628 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ece88eb0-67f0-4919-892f-005ba510ca5b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:23.448633 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ece88eb0-67f0-4919-892f-005ba510ca5b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:23.449232 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ece88eb0-67f0-4919-892f-005ba510ca5b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:23.826237 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ece88eb0-67f0-4919-892f-005ba510ca5b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:23.842026 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ece88eb0-67f0-4919-892f-005ba510ca5b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:23.843585 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ece88eb0-67f0-4919-892f-005ba510ca5b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:23.853114 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ece88eb0-67f0-4919-892f-005ba510ca5b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1739 microversion: 2.20 time: 0.418468 Jun 17 11:47:23.853114 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 382/771] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:23 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1739 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:47:23.866991 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-4ece91f3-f51c-4627-a66f-effc829159b4 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:23.879726 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4ece91f3-f51c-4627-a66f-effc829159b4 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3" status: 200 len: 1368 microversion: 2.1 time: 0.490643 Jun 17 11:47:23.881032 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 390/772] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:47:23 2022] GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3 => generated 1368 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:47:24.873077 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-06ca0307-d6b9-43a5-b866-7cdc2f88ce64 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:24.874521 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-06ca0307-d6b9-43a5-b866-7cdc2f88ce64 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:24.880424 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=2 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:47:24.880424 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=10 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:47:24.903339 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-06ca0307-d6b9-43a5-b866-7cdc2f88ce64 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:24.904145 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-06ca0307-d6b9-43a5-b866-7cdc2f88ce64 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:24.909404 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-06ca0307-d6b9-43a5-b866-7cdc2f88ce64 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:24.909404 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-06ca0307-d6b9-43a5-b866-7cdc2f88ce64 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:24.912497 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-76a0fc4a-7ec0-440e-8340-f2ef31209f4b tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:24.913125 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-76a0fc4a-7ec0-440e-8340-f2ef31209f4b tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 52cfb97a-c546-496a-9557-1663ada483b3] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:24.921957 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-76a0fc4a-7ec0-440e-8340-f2ef31209f4b tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:24.922710 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-76a0fc4a-7ec0-440e-8340-f2ef31209f4b tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:24.923890 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-76a0fc4a-7ec0-440e-8340-f2ef31209f4b tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:24.925731 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-76a0fc4a-7ec0-440e-8340-f2ef31209f4b tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:24.957282 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=100 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:47:25.180709 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-06ca0307-d6b9-43a5-b866-7cdc2f88ce64 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:25.195346 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-06ca0307-d6b9-43a5-b866-7cdc2f88ce64 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:25.197082 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-06ca0307-d6b9-43a5-b866-7cdc2f88ce64 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:25.198423 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-06ca0307-d6b9-43a5-b866-7cdc2f88ce64 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1739 microversion: 2.20 time: 0.332925 Jun 17 11:47:25.203307 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 383/773] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:24 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1739 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:47:25.224716 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-76a0fc4a-7ec0-440e-8340-f2ef31209f4b tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:25.234329 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-76a0fc4a-7ec0-440e-8340-f2ef31209f4b tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3" status: 200 len: 1368 microversion: 2.1 time: 0.332753 Jun 17 11:47:25.235241 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 391/774] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:47:24 2022] GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3 => generated 1368 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:47:26.230309 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-526a95dc-19a9-4bc1-ab11-c390d9ff6366 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:26.253010 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-526a95dc-19a9-4bc1-ab11-c390d9ff6366 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:26.253557 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9535c653-fe88-4ade-8e53-63f761c30088 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:26.254247 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9535c653-fe88-4ade-8e53-63f761c30088 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 52cfb97a-c546-496a-9557-1663ada483b3] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:26.256539 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=4 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:47:26.265788 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-526a95dc-19a9-4bc1-ab11-c390d9ff6366 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:26.266916 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-526a95dc-19a9-4bc1-ab11-c390d9ff6366 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:26.268810 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-526a95dc-19a9-4bc1-ab11-c390d9ff6366 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:26.269172 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9535c653-fe88-4ade-8e53-63f761c30088 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:26.269655 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9535c653-fe88-4ade-8e53-63f761c30088 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:26.270642 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-526a95dc-19a9-4bc1-ab11-c390d9ff6366 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:26.270793 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9535c653-fe88-4ade-8e53-63f761c30088 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:26.271236 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9535c653-fe88-4ade-8e53-63f761c30088 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:26.590468 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9535c653-fe88-4ade-8e53-63f761c30088 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:26.602505 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9535c653-fe88-4ade-8e53-63f761c30088 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3" status: 200 len: 1368 microversion: 2.1 time: 0.353377 Jun 17 11:47:26.613080 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 392/775] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:47:26 2022] GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3 => generated 1368 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:47:26.613858 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-526a95dc-19a9-4bc1-ab11-c390d9ff6366 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:26.621808 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-526a95dc-19a9-4bc1-ab11-c390d9ff6366 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:26.623413 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-526a95dc-19a9-4bc1-ab11-c390d9ff6366 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:26.626372 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-526a95dc-19a9-4bc1-ab11-c390d9ff6366 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1739 microversion: 2.20 time: 0.399833 Jun 17 11:47:26.626977 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 384/776] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:26 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1739 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:47:27.631118 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-93b8b5d4-221f-4656-b853-d3dc60f6e04e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:27.637061 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-93b8b5d4-221f-4656-b853-d3dc60f6e04e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 52cfb97a-c546-496a-9557-1663ada483b3] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:27.651266 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-93b8b5d4-221f-4656-b853-d3dc60f6e04e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:27.651770 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-93b8b5d4-221f-4656-b853-d3dc60f6e04e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:27.652756 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-93b8b5d4-221f-4656-b853-d3dc60f6e04e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:27.653202 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-93b8b5d4-221f-4656-b853-d3dc60f6e04e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:27.680558 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1aa5cdf9-f3c2-4270-885f-791a6028a0c7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:27.680558 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-1aa5cdf9-f3c2-4270-885f-791a6028a0c7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:27.694716 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1aa5cdf9-f3c2-4270-885f-791a6028a0c7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:27.695397 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1aa5cdf9-f3c2-4270-885f-791a6028a0c7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:27.697419 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1aa5cdf9-f3c2-4270-885f-791a6028a0c7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:27.698374 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1aa5cdf9-f3c2-4270-885f-791a6028a0c7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:27.985763 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-93b8b5d4-221f-4656-b853-d3dc60f6e04e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:27.999322 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-93b8b5d4-221f-4656-b853-d3dc60f6e04e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3" status: 200 len: 1368 microversion: 2.1 time: 0.381090 Jun 17 11:47:28.007439 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 393/777] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:47:27 2022] GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3 => generated 1368 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:47:28.010380 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-0aca19de-ee38-4660-90fc-3062b2905061 req-e244db26-ea66-41aa-94c8-888669fba974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52cfb97a-c546-496a-9557-1663ada483b3", "name": "network-vif-plugged", "status": "completed", "tag": "ec529d14-50c4-4d90-8fe1-d7b22fa82064"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:47:28.024241 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-0aca19de-ee38-4660-90fc-3062b2905061 req-e244db26-ea66-41aa-94c8-888669fba974 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:28.024948 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-0aca19de-ee38-4660-90fc-3062b2905061 req-e244db26-ea66-41aa-94c8-888669fba974 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:28.050320 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-1aa5cdf9-f3c2-4270-885f-791a6028a0c7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:28.051462 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-0aca19de-ee38-4660-90fc-3062b2905061 req-e244db26-ea66-41aa-94c8-888669fba974 service nova] Creating event network-vif-plugged:ec529d14-50c4-4d90-8fe1-d7b22fa82064 for instance 52cfb97a-c546-496a-9557-1663ada483b3 on hv-cinder-83716 Jun 17 11:47:28.060367 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-0aca19de-ee38-4660-90fc-3062b2905061 req-e244db26-ea66-41aa-94c8-888669fba974 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058071 Jun 17 11:47:28.060740 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-1aa5cdf9-f3c2-4270-885f-791a6028a0c7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:28.061826 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 394/778] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:47:28.065143 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-1aa5cdf9-f3c2-4270-885f-791a6028a0c7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:28.067963 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-1aa5cdf9-f3c2-4270-885f-791a6028a0c7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1739 microversion: 2.20 time: 0.411319 Jun 17 11:47:28.071524 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 385/779] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:27 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1739 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:47:28.072100 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0172d83b-c478-4e72-8e43-76bcc6c91aba tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:28.073724 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0172d83b-c478-4e72-8e43-76bcc6c91aba tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:28.083460 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0172d83b-c478-4e72-8e43-76bcc6c91aba tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:28.084006 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0172d83b-c478-4e72-8e43-76bcc6c91aba tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:28.085045 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0172d83b-c478-4e72-8e43-76bcc6c91aba tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:28.085560 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0172d83b-c478-4e72-8e43-76bcc6c91aba tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:28.146306 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0172d83b-c478-4e72-8e43-76bcc6c91aba tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081943 Jun 17 11:47:28.147168 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 395/780] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 17 11:47:28 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:47:28.162644 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-06033efe-176d-402a-bc3e-274e686e7adf tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:28.163272 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-06033efe-176d-402a-bc3e-274e686e7adf tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:28.169910 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-06033efe-176d-402a-bc3e-274e686e7adf tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:28.170368 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-06033efe-176d-402a-bc3e-274e686e7adf tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:28.171182 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-06033efe-176d-402a-bc3e-274e686e7adf tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:28.171657 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-06033efe-176d-402a-bc3e-274e686e7adf tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:28.206701 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-06033efe-176d-402a-bc3e-274e686e7adf tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892/os-volume_attachments/c04a7e7e-9008-4580-bc50-ffe713d3bbbd" status: 200 len: 194 microversion: 2.1 time: 0.052227 Jun 17 11:47:28.215065 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 386/781] 10.222.0.45 () {58 vars in 1412 bytes} [Fri Jun 17 11:47:28 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892/os-volume_attachments/c04a7e7e-9008-4580-bc50-ffe713d3bbbd => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:47:29.028349 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4da2c55f-a76b-45b6-acf2-7714755432f8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:29.029376 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4da2c55f-a76b-45b6-acf2-7714755432f8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 52cfb97a-c546-496a-9557-1663ada483b3] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:29.040627 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4da2c55f-a76b-45b6-acf2-7714755432f8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:29.041111 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4da2c55f-a76b-45b6-acf2-7714755432f8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:29.042125 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4da2c55f-a76b-45b6-acf2-7714755432f8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:29.042839 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4da2c55f-a76b-45b6-acf2-7714755432f8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:29.088858 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3a1d62de-3924-454a-b4ff-5e8044ae5814 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:29.090194 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-3a1d62de-3924-454a-b4ff-5e8044ae5814 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:29.132229 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3a1d62de-3924-454a-b4ff-5e8044ae5814 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:29.133011 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3a1d62de-3924-454a-b4ff-5e8044ae5814 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:29.136222 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3a1d62de-3924-454a-b4ff-5e8044ae5814 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:29.137072 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3a1d62de-3924-454a-b4ff-5e8044ae5814 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:29.293314 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-4da2c55f-a76b-45b6-acf2-7714755432f8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:29.305944 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4da2c55f-a76b-45b6-acf2-7714755432f8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3" status: 200 len: 1368 microversion: 2.1 time: 0.281700 Jun 17 11:47:29.308221 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 396/782] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:47:29 2022] GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3 => generated 1368 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:47:29.433231 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3a1d62de-3924-454a-b4ff-5e8044ae5814 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:29.445604 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3a1d62de-3924-454a-b4ff-5e8044ae5814 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:29.448268 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3a1d62de-3924-454a-b4ff-5e8044ae5814 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:29.450229 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-3a1d62de-3924-454a-b4ff-5e8044ae5814 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1739 microversion: 2.20 time: 0.365221 Jun 17 11:47:29.462166 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 387/783] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:29 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1739 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:47:30.136296 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f7d79d82-2c1b-4871-a328-b2d5947b140b tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5090d0d3-ab9f-4264-b92d-ec51f32d8c71"}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:47:30.138248 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f7d79d82-2c1b-4871-a328-b2d5947b140b tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:30.145687 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f7d79d82-2c1b-4871-a328-b2d5947b140b tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:30.146139 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f7d79d82-2c1b-4871-a328-b2d5947b140b tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:30.147187 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f7d79d82-2c1b-4871-a328-b2d5947b140b tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:30.147955 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f7d79d82-2c1b-4871-a328-b2d5947b140b tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:30.326354 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-940b05c0-689e-4181-ab21-36b70be57952 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:30.333233 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-940b05c0-689e-4181-ab21-36b70be57952 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 52cfb97a-c546-496a-9557-1663ada483b3] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:30.340984 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-940b05c0-689e-4181-ab21-36b70be57952 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:30.342171 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-940b05c0-689e-4181-ab21-36b70be57952 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:30.343005 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-940b05c0-689e-4181-ab21-36b70be57952 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:30.343491 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-940b05c0-689e-4181-ab21-36b70be57952 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:30.534106 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-940b05c0-689e-4181-ab21-36b70be57952 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:30.544241 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-940b05c0-689e-4181-ab21-36b70be57952 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3" status: 200 len: 1368 microversion: 2.1 time: 0.221866 Jun 17 11:47:30.555485 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 388/784] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:47:30 2022] GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3 => generated 1368 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:47:30.555485 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e6fcc4d6-30bd-4680-885c-5484442e4863 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:30.555485 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e6fcc4d6-30bd-4680-885c-5484442e4863 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:30.559010 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e6fcc4d6-30bd-4680-885c-5484442e4863 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:30.559737 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e6fcc4d6-30bd-4680-885c-5484442e4863 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:30.560729 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e6fcc4d6-30bd-4680-885c-5484442e4863 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:30.561328 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e6fcc4d6-30bd-4680-885c-5484442e4863 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:30.804115 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e6fcc4d6-30bd-4680-885c-5484442e4863 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:30.860185 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e6fcc4d6-30bd-4680-885c-5484442e4863 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:30.867827 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e6fcc4d6-30bd-4680-885c-5484442e4863 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:30.870423 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e6fcc4d6-30bd-4680-885c-5484442e4863 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1739 microversion: 2.20 time: 0.323193 Jun 17 11:47:30.896293 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 389/785] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:30 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1739 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:47:31.565126 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a449f761-0312-4fe3-91b4-710bdb58f396 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:31.566933 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a449f761-0312-4fe3-91b4-710bdb58f396 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 52cfb97a-c546-496a-9557-1663ada483b3] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:31.578608 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a449f761-0312-4fe3-91b4-710bdb58f396 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:31.579117 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a449f761-0312-4fe3-91b4-710bdb58f396 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:31.579927 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a449f761-0312-4fe3-91b4-710bdb58f396 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:31.581449 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a449f761-0312-4fe3-91b4-710bdb58f396 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:31.636637 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f7d79d82-2c1b-4871-a328-b2d5947b140b tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "POST /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.503996 Jun 17 11:47:31.651839 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 397/786] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jun 17 11:47:30 2022] POST /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892/os-volume_attachments => generated 194 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:47:31.797226 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a449f761-0312-4fe3-91b4-710bdb58f396 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:31.810614 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a449f761-0312-4fe3-91b4-710bdb58f396 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3" status: 200 len: 1557 microversion: 2.1 time: 0.251241 Jun 17 11:47:31.811325 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 390/787] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:47:31 2022] GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3 => generated 1557 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:47:31.857717 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-43a63958-ded5-428c-8566-860dc13aaa84 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:31.870457 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-43a63958-ded5-428c-8566-860dc13aaa84 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 52cfb97a-c546-496a-9557-1663ada483b3] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:31.896403 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-43a63958-ded5-428c-8566-860dc13aaa84 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:31.896913 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-43a63958-ded5-428c-8566-860dc13aaa84 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:31.898187 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-43a63958-ded5-428c-8566-860dc13aaa84 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:31.898641 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-43a63958-ded5-428c-8566-860dc13aaa84 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:31.908164 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c82ffceb-28ac-4a66-8827-e9c0853b4695 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:31.909745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c82ffceb-28ac-4a66-8827-e9c0853b4695 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:31.973654 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c82ffceb-28ac-4a66-8827-e9c0853b4695 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:31.975052 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c82ffceb-28ac-4a66-8827-e9c0853b4695 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:31.977246 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c82ffceb-28ac-4a66-8827-e9c0853b4695 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:31.978115 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c82ffceb-28ac-4a66-8827-e9c0853b4695 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:32.073291 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-43a63958-ded5-428c-8566-860dc13aaa84 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.238578 Jun 17 11:47:32.073948 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 398/788] 10.222.0.45 () {58 vars in 1274 bytes} [Fri Jun 17 11:47:31 2022] GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3/os-interface => generated 284 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:47:32.230172 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c82ffceb-28ac-4a66-8827-e9c0853b4695 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:32.240907 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c82ffceb-28ac-4a66-8827-e9c0853b4695 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:32.242553 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c82ffceb-28ac-4a66-8827-e9c0853b4695 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:32.243971 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c82ffceb-28ac-4a66-8827-e9c0853b4695 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1739 microversion: 2.20 time: 0.340409 Jun 17 11:47:32.244683 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 391/789] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:31 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1739 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:47:33.276745 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-baac74c4-af30-40e4-aab5-e80a71b2faad tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:33.282076 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-baac74c4-af30-40e4-aab5-e80a71b2faad tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:33.291772 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-baac74c4-af30-40e4-aab5-e80a71b2faad tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:33.293272 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-baac74c4-af30-40e4-aab5-e80a71b2faad tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:33.295170 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-baac74c4-af30-40e4-aab5-e80a71b2faad tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:33.295984 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-baac74c4-af30-40e4-aab5-e80a71b2faad tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:33.476419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-baac74c4-af30-40e4-aab5-e80a71b2faad tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:33.490200 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-baac74c4-af30-40e4-aab5-e80a71b2faad tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:33.492183 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-baac74c4-af30-40e4-aab5-e80a71b2faad tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:33.493830 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-baac74c4-af30-40e4-aab5-e80a71b2faad tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1739 microversion: 2.20 time: 0.223737 Jun 17 11:47:33.494953 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 399/790] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:33 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1739 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:47:34.035725 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-d103e946-09ce-4e89-a0ca-6fbc8d448977 req-9aebd58a-f0a2-4f2d-a544-d60a8186fd4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52cfb97a-c546-496a-9557-1663ada483b3", "tag": "ec529d14-50c4-4d90-8fe1-d7b22fa82064"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:47:34.047346 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-d103e946-09ce-4e89-a0ca-6fbc8d448977 req-9aebd58a-f0a2-4f2d-a544-d60a8186fd4c service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:34.048105 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-d103e946-09ce-4e89-a0ca-6fbc8d448977 req-9aebd58a-f0a2-4f2d-a544-d60a8186fd4c service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:34.069289 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-d103e946-09ce-4e89-a0ca-6fbc8d448977 req-9aebd58a-f0a2-4f2d-a544-d60a8186fd4c service nova] Creating event network-changed:ec529d14-50c4-4d90-8fe1-d7b22fa82064 for instance 52cfb97a-c546-496a-9557-1663ada483b3 on hv-cinder-83716 Jun 17 11:47:34.078109 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-d103e946-09ce-4e89-a0ca-6fbc8d448977 req-9aebd58a-f0a2-4f2d-a544-d60a8186fd4c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.310011 Jun 17 11:47:34.078834 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 392/791] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:47:34.523332 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-5f94b2c0-bc2c-4da6-8f7b-59d9284e54ec tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:34.529148 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-5f94b2c0-bc2c-4da6-8f7b-59d9284e54ec tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:34.538941 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5f94b2c0-bc2c-4da6-8f7b-59d9284e54ec tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:34.539428 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5f94b2c0-bc2c-4da6-8f7b-59d9284e54ec tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:34.540238 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5f94b2c0-bc2c-4da6-8f7b-59d9284e54ec tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:34.540675 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5f94b2c0-bc2c-4da6-8f7b-59d9284e54ec tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:34.789881 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5f94b2c0-bc2c-4da6-8f7b-59d9284e54ec tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:34.798821 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5f94b2c0-bc2c-4da6-8f7b-59d9284e54ec tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:34.801042 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5f94b2c0-bc2c-4da6-8f7b-59d9284e54ec tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:34.802482 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-5f94b2c0-bc2c-4da6-8f7b-59d9284e54ec tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1739 microversion: 2.20 time: 0.284842 Jun 17 11:47:34.813217 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 400/792] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:34 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1739 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:47:35.823926 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3cb1d53f-0631-44cd-906e-81419dbad2d5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:35.825452 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-3cb1d53f-0631-44cd-906e-81419dbad2d5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:35.832698 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3cb1d53f-0631-44cd-906e-81419dbad2d5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:35.833157 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3cb1d53f-0631-44cd-906e-81419dbad2d5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:35.833987 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3cb1d53f-0631-44cd-906e-81419dbad2d5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:35.834435 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3cb1d53f-0631-44cd-906e-81419dbad2d5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:36.101346 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3cb1d53f-0631-44cd-906e-81419dbad2d5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:36.109340 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3cb1d53f-0631-44cd-906e-81419dbad2d5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:36.111721 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3cb1d53f-0631-44cd-906e-81419dbad2d5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:36.113070 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-3cb1d53f-0631-44cd-906e-81419dbad2d5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1721 microversion: 2.20 time: 0.294718 Jun 17 11:47:36.113783 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 393/793] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:35 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1721 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:47:37.137822 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-7c7d1f0f-b678-4dea-9148-bfa31d864234 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:37.138889 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-7c7d1f0f-b678-4dea-9148-bfa31d864234 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:37.154545 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7c7d1f0f-b678-4dea-9148-bfa31d864234 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:37.155394 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7c7d1f0f-b678-4dea-9148-bfa31d864234 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:37.157115 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7c7d1f0f-b678-4dea-9148-bfa31d864234 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:37.158107 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7c7d1f0f-b678-4dea-9148-bfa31d864234 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:37.351137 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-7c7d1f0f-b678-4dea-9148-bfa31d864234 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:37.360095 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-7c7d1f0f-b678-4dea-9148-bfa31d864234 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:37.362930 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-7c7d1f0f-b678-4dea-9148-bfa31d864234 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:37.364537 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-7c7d1f0f-b678-4dea-9148-bfa31d864234 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1721 microversion: 2.20 time: 0.234071 Jun 17 11:47:37.365110 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 401/794] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:37 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1721 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:47:38.384719 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-7629112d-51a9-402b-800a-80cb74b4e721 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:38.385478 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7629112d-51a9-402b-800a-80cb74b4e721 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:38.393122 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7629112d-51a9-402b-800a-80cb74b4e721 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:38.393580 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7629112d-51a9-402b-800a-80cb74b4e721 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:38.394492 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7629112d-51a9-402b-800a-80cb74b4e721 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:38.395004 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7629112d-51a9-402b-800a-80cb74b4e721 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:38.573325 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7629112d-51a9-402b-800a-80cb74b4e721 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:38.583304 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7629112d-51a9-402b-800a-80cb74b4e721 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:38.585024 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7629112d-51a9-402b-800a-80cb74b4e721 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:38.586316 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-7629112d-51a9-402b-800a-80cb74b4e721 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1721 microversion: 2.20 time: 0.205836 Jun 17 11:47:38.586937 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 394/795] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:38 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:47:39.497499 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-c67a661b-c7b6-4d75-9631-49bd54bb37ea req-9ac0a016-44a7-4248-8730-ac62c8018c40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4eb9c8c-b733-475e-b69e-279e9295ac4d", "name": "network-vif-unplugged", "status": "completed", "tag": "f00e28a8-041d-4c99-8685-2e89673ad6b8"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:47:39.511181 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-c67a661b-c7b6-4d75-9631-49bd54bb37ea req-9ac0a016-44a7-4248-8730-ac62c8018c40 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:39.511653 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-c67a661b-c7b6-4d75-9631-49bd54bb37ea req-9ac0a016-44a7-4248-8730-ac62c8018c40 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:39.524083 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-c67a661b-c7b6-4d75-9631-49bd54bb37ea req-9ac0a016-44a7-4248-8730-ac62c8018c40 service nova] Creating event network-vif-unplugged:f00e28a8-041d-4c99-8685-2e89673ad6b8 for instance f4eb9c8c-b733-475e-b69e-279e9295ac4d on hv-cinder-83716 Jun 17 11:47:39.534303 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-c67a661b-c7b6-4d75-9631-49bd54bb37ea req-9ac0a016-44a7-4248-8730-ac62c8018c40 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043937 Jun 17 11:47:39.536561 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 402/796] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:47:39.612736 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-42319798-7126-4fd3-a2f6-0a8e5192688d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:39.613900 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-42319798-7126-4fd3-a2f6-0a8e5192688d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:39.621921 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-42319798-7126-4fd3-a2f6-0a8e5192688d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:39.622372 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-42319798-7126-4fd3-a2f6-0a8e5192688d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:39.623357 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-42319798-7126-4fd3-a2f6-0a8e5192688d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:39.623844 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-42319798-7126-4fd3-a2f6-0a8e5192688d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:39.789353 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-42319798-7126-4fd3-a2f6-0a8e5192688d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:39.800446 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-42319798-7126-4fd3-a2f6-0a8e5192688d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:39.802125 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-42319798-7126-4fd3-a2f6-0a8e5192688d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:39.803625 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-42319798-7126-4fd3-a2f6-0a8e5192688d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1724 microversion: 2.20 time: 0.200338 Jun 17 11:47:39.804392 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 395/797] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:39 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:47:39.824269 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-fd44faf8-dbe2-4e17-a316-3b3f1fd6a7ee tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "700e65d0-43c6-4663-9a1d-d0c4db04402a"}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:47:39.825553 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-fd44faf8-dbe2-4e17-a316-3b3f1fd6a7ee tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:39.832342 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fd44faf8-dbe2-4e17-a316-3b3f1fd6a7ee tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:39.832801 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fd44faf8-dbe2-4e17-a316-3b3f1fd6a7ee tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:39.833631 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fd44faf8-dbe2-4e17-a316-3b3f1fd6a7ee tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:39.834054 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fd44faf8-dbe2-4e17-a316-3b3f1fd6a7ee tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:39.937089 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:47:41.572274 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ed43aa7c-02fe-44a2-b17a-ecfbb402c3c0 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:41.573253 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ed43aa7c-02fe-44a2-b17a-ecfbb402c3c0 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:41.580183 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ed43aa7c-02fe-44a2-b17a-ecfbb402c3c0 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:41.584947 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ed43aa7c-02fe-44a2-b17a-ecfbb402c3c0 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:41.584947 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ed43aa7c-02fe-44a2-b17a-ecfbb402c3c0 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:41.584947 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ed43aa7c-02fe-44a2-b17a-ecfbb402c3c0 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:41.618586 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ed43aa7c-02fe-44a2-b17a-ecfbb402c3c0 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050253 Jun 17 11:47:41.619179 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 396/798] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 17 11:47:41 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:47:41.701872 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-fd44faf8-dbe2-4e17-a316-3b3f1fd6a7ee tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "POST /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.882345 Jun 17 11:47:41.702851 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 403/799] 10.222.0.45 () {62 vars in 1363 bytes} [Fri Jun 17 11:47:39 2022] POST /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d/os-volume_attachments => generated 188 bytes in 1884 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 11:47:41.765354 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-016044b3-6bae-4355-851e-4818a673df84 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:41.765354 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-016044b3-6bae-4355-851e-4818a673df84 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:41.769174 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-016044b3-6bae-4355-851e-4818a673df84 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:41.769636 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-016044b3-6bae-4355-851e-4818a673df84 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:41.770449 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-016044b3-6bae-4355-851e-4818a673df84 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:41.770891 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-016044b3-6bae-4355-851e-4818a673df84 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:41.812700 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-016044b3-6bae-4355-851e-4818a673df84 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892/os-volume_attachments/c04a7e7e-9008-4580-bc50-ffe713d3bbbd" status: 200 len: 194 microversion: 2.1 time: 0.055764 Jun 17 11:47:41.818863 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 397/800] 10.222.0.45 () {58 vars in 1412 bytes} [Fri Jun 17 11:47:41 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892/os-volume_attachments/c04a7e7e-9008-4580-bc50-ffe713d3bbbd => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:47:41.824572 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b464954a-82a0-4697-aaae-f26fc8319538 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:41.831316 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b464954a-82a0-4697-aaae-f26fc8319538 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:41.832220 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b464954a-82a0-4697-aaae-f26fc8319538 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:41.832681 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b464954a-82a0-4697-aaae-f26fc8319538 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:41.833482 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b464954a-82a0-4697-aaae-f26fc8319538 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:41.833923 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b464954a-82a0-4697-aaae-f26fc8319538 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:41.845787 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-dde32f23-0803-46b8-bc46-2d60565f1f89 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:41.846303 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-dde32f23-0803-46b8-bc46-2d60565f1f89 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:41.852813 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dde32f23-0803-46b8-bc46-2d60565f1f89 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:41.853268 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dde32f23-0803-46b8-bc46-2d60565f1f89 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:41.854178 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dde32f23-0803-46b8-bc46-2d60565f1f89 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:41.854483 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dde32f23-0803-46b8-bc46-2d60565f1f89 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:42.007036 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-b464954a-82a0-4697-aaae-f26fc8319538 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lazy-loading 'services' on Instance uuid 2ed47de2-4bfc-4635-8345-47b1cc369892 {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:47:42.404817 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b464954a-82a0-4697-aaae-f26fc8319538 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892/os-volume_attachments/c04a7e7e-9008-4580-bc50-ffe713d3bbbd" status: 202 len: 0 microversion: 2.1 time: 0.584150 Jun 17 11:47:42.405634 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 404/801] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Jun 17 11:47:41 2022] DELETE /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892/os-volume_attachments/c04a7e7e-9008-4580-bc50-ffe713d3bbbd => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 11:47:42.552106 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:47:42.703092 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-dde32f23-0803-46b8-bc46-2d60565f1f89 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d/os-volume_attachments/700e65d0-43c6-4663-9a1d-d0c4db04402a" status: 202 len: 0 microversion: 2.20 time: 0.861506 Jun 17 11:47:42.704001 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 398/802] 10.222.0.45 () {60 vars in 1456 bytes} [Fri Jun 17 11:47:41 2022] DELETE /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d/os-volume_attachments/700e65d0-43c6-4663-9a1d-d0c4db04402a => generated 0 bytes in 863 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 17 11:47:42.769753 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-21843f22-6f32-41f7-ad3f-285ef3a567cf tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:47:42.769753 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-21843f22-6f32-41f7-ad3f-285ef3a567cf tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:42.778008 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-21843f22-6f32-41f7-ad3f-285ef3a567cf tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:42.778008 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-21843f22-6f32-41f7-ad3f-285ef3a567cf tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:42.778008 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-21843f22-6f32-41f7-ad3f-285ef3a567cf tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:42.778008 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-21843f22-6f32-41f7-ad3f-285ef3a567cf tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:43.100357 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-21843f22-6f32-41f7-ad3f-285ef3a567cf tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "POST /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d/action" status: 202 len: 0 microversion: 2.20 time: 0.337757 Jun 17 11:47:43.101018 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 405/803] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jun 17 11:47:42 2022] POST /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 17 11:47:43.109779 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-bf2cd60b-a8e2-4f65-8b7e-8a6d75c09903 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:43.110397 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-bf2cd60b-a8e2-4f65-8b7e-8a6d75c09903 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:43.119233 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bf2cd60b-a8e2-4f65-8b7e-8a6d75c09903 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:43.119573 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bf2cd60b-a8e2-4f65-8b7e-8a6d75c09903 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:43.120367 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bf2cd60b-a8e2-4f65-8b7e-8a6d75c09903 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:43.120807 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bf2cd60b-a8e2-4f65-8b7e-8a6d75c09903 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:43.265304 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-bf2cd60b-a8e2-4f65-8b7e-8a6d75c09903 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:43.275812 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-bf2cd60b-a8e2-4f65-8b7e-8a6d75c09903 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:43.277428 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-bf2cd60b-a8e2-4f65-8b7e-8a6d75c09903 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:43.278757 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-bf2cd60b-a8e2-4f65-8b7e-8a6d75c09903 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1672 microversion: 2.20 time: 0.173411 Jun 17 11:47:43.279514 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 399/804] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:43 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1672 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:47:44.301534 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6543202f-ac86-48c4-816d-2921d23fd357 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:44.301534 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-6543202f-ac86-48c4-816d-2921d23fd357 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:44.308036 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6543202f-ac86-48c4-816d-2921d23fd357 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:44.308476 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6543202f-ac86-48c4-816d-2921d23fd357 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:44.309251 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6543202f-ac86-48c4-816d-2921d23fd357 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:44.311953 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6543202f-ac86-48c4-816d-2921d23fd357 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:44.505379 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6543202f-ac86-48c4-816d-2921d23fd357 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:44.514036 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6543202f-ac86-48c4-816d-2921d23fd357 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:44.515672 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6543202f-ac86-48c4-816d-2921d23fd357 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:44.516858 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-6543202f-ac86-48c4-816d-2921d23fd357 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1672 microversion: 2.20 time: 0.221865 Jun 17 11:47:44.517434 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 406/805] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:44 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1672 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:47:44.595314 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-7336fa89-af61-4f53-a673-341e83a9c8a6 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:44.596685 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7336fa89-af61-4f53-a673-341e83a9c8a6 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:44.603279 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7336fa89-af61-4f53-a673-341e83a9c8a6 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:44.603772 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7336fa89-af61-4f53-a673-341e83a9c8a6 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:44.604563 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7336fa89-af61-4f53-a673-341e83a9c8a6 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:44.605008 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7336fa89-af61-4f53-a673-341e83a9c8a6 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:44.641531 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-7336fa89-af61-4f53-a673-341e83a9c8a6 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892/os-volume_attachments/5090d0d3-ab9f-4264-b92d-ec51f32d8c71" status: 200 len: 194 microversion: 2.1 time: 0.049823 Jun 17 11:47:44.645306 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 400/806] 10.222.0.45 () {58 vars in 1412 bytes} [Fri Jun 17 11:47:44 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892/os-volume_attachments/5090d0d3-ab9f-4264-b92d-ec51f32d8c71 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:47:44.665029 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-caec1118-346d-4255-bef8-4f6da8e1a166 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:44.666092 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-caec1118-346d-4255-bef8-4f6da8e1a166 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:44.668072 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=60 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:47:44.673473 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-caec1118-346d-4255-bef8-4f6da8e1a166 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:44.674191 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-caec1118-346d-4255-bef8-4f6da8e1a166 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:44.675150 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-caec1118-346d-4255-bef8-4f6da8e1a166 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:44.675632 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-caec1118-346d-4255-bef8-4f6da8e1a166 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:44.768606 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-caec1118-346d-4255-bef8-4f6da8e1a166 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lazy-loading 'services' on Instance uuid 2ed47de2-4bfc-4635-8345-47b1cc369892 {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:47:45.117997 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-caec1118-346d-4255-bef8-4f6da8e1a166 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892/os-volume_attachments/5090d0d3-ab9f-4264-b92d-ec51f32d8c71" status: 202 len: 0 microversion: 2.1 time: 0.458513 Jun 17 11:47:45.122750 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 407/807] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Jun 17 11:47:44 2022] DELETE /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892/os-volume_attachments/5090d0d3-ab9f-4264-b92d-ec51f32d8c71 => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 11:47:45.291358 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-019831c1-2530-4937-8052-3c5ca346086d tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1887351586"}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:47:45.297276 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-019831c1-2530-4937-8052-3c5ca346086d tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:45.300296 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-019831c1-2530-4937-8052-3c5ca346086d tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:45.300754 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-019831c1-2530-4937-8052-3c5ca346086d tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:45.301541 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-019831c1-2530-4937-8052-3c5ca346086d tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:45.301966 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-019831c1-2530-4937-8052-3c5ca346086d tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:45.452306 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.network.security_group_api [None req-019831c1-2530-4937-8052-3c5ca346086d tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Removing security group 8d91bc0d-447a-4a42-893d-4ee42b359dc9 from port f866082a-76d6-466b-8c49-7a5068d4d87f Jun 17 11:47:45.539103 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c89d8a2f-4cc6-42e5-9d12-9bcd4d7c47ba tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:45.540648 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c89d8a2f-4cc6-42e5-9d12-9bcd4d7c47ba tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:45.547504 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c89d8a2f-4cc6-42e5-9d12-9bcd4d7c47ba tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:45.547951 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c89d8a2f-4cc6-42e5-9d12-9bcd4d7c47ba tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:45.548723 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c89d8a2f-4cc6-42e5-9d12-9bcd4d7c47ba tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:45.549763 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c89d8a2f-4cc6-42e5-9d12-9bcd4d7c47ba tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:45.950600 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c89d8a2f-4cc6-42e5-9d12-9bcd4d7c47ba tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:45.968305 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c89d8a2f-4cc6-42e5-9d12-9bcd4d7c47ba tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:45.970009 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c89d8a2f-4cc6-42e5-9d12-9bcd4d7c47ba tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:45.972255 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c89d8a2f-4cc6-42e5-9d12-9bcd4d7c47ba tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1674 microversion: 2.20 time: 0.439376 Jun 17 11:47:45.972951 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 408/808] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:45 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1674 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:47:46.120970 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-019831c1-2530-4937-8052-3c5ca346086d tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "POST /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/action" status: 202 len: 0 microversion: 2.1 time: 0.833504 Jun 17 11:47:46.125201 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 401/809] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jun 17 11:47:45 2022] POST /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/action => generated 0 bytes in 835 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 11:47:46.130972 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-617c761d-bbfd-49ce-a001-045e08be2505 req-c9d1741b-5843-4605-a392-00eda97d26c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907", "tag": "f866082a-76d6-466b-8c49-7a5068d4d87f"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:47:46.149878 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-617c761d-bbfd-49ce-a001-045e08be2505 req-c9d1741b-5843-4605-a392-00eda97d26c6 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:46.150522 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-617c761d-bbfd-49ce-a001-045e08be2505 req-c9d1741b-5843-4605-a392-00eda97d26c6 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:46.179721 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-617c761d-bbfd-49ce-a001-045e08be2505 req-c9d1741b-5843-4605-a392-00eda97d26c6 service nova] Creating event network-changed:f866082a-76d6-466b-8c49-7a5068d4d87f for instance 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 on hv-cinder-83716 Jun 17 11:47:46.195343 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-617c761d-bbfd-49ce-a001-045e08be2505 req-c9d1741b-5843-4605-a392-00eda97d26c6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068693 Jun 17 11:47:46.203893 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 409/810] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:47:47.014946 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-10d94408-0bb0-455a-937b-aa4256343c60 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:47.014946 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-10d94408-0bb0-455a-937b-aa4256343c60 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:47.014946 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-10d94408-0bb0-455a-937b-aa4256343c60 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:47.014946 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-10d94408-0bb0-455a-937b-aa4256343c60 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:47.016074 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-10d94408-0bb0-455a-937b-aa4256343c60 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:47.016672 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-10d94408-0bb0-455a-937b-aa4256343c60 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:47.305248 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-10d94408-0bb0-455a-937b-aa4256343c60 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:47.316679 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-10d94408-0bb0-455a-937b-aa4256343c60 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:47.318282 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-10d94408-0bb0-455a-937b-aa4256343c60 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:47.319589 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-10d94408-0bb0-455a-937b-aa4256343c60 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1730 microversion: 2.20 time: 0.322848 Jun 17 11:47:47.320389 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 402/811] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:46 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1730 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:47:47.463887 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c8f317ba-2646-47d1-85f3-86994e9a9166 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:47.465857 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c8f317ba-2646-47d1-85f3-86994e9a9166 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:47.478794 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c8f317ba-2646-47d1-85f3-86994e9a9166 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:47.479566 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c8f317ba-2646-47d1-85f3-86994e9a9166 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:47.483280 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c8f317ba-2646-47d1-85f3-86994e9a9166 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:47.483280 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c8f317ba-2646-47d1-85f3-86994e9a9166 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:47.519824 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c8f317ba-2646-47d1-85f3-86994e9a9166 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064162 Jun 17 11:47:47.521108 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 410/812] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 17 11:47:47 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 11:47:47.696806 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-fabbd6e5-da60-4a07-97a3-a9315ec25a66 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:47.698676 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-fabbd6e5-da60-4a07-97a3-a9315ec25a66 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:47.710559 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fabbd6e5-da60-4a07-97a3-a9315ec25a66 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:47.711439 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fabbd6e5-da60-4a07-97a3-a9315ec25a66 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:47.713027 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fabbd6e5-da60-4a07-97a3-a9315ec25a66 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:47.713734 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fabbd6e5-da60-4a07-97a3-a9315ec25a66 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:47.764127 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-fabbd6e5-da60-4a07-97a3-a9315ec25a66 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075395 Jun 17 11:47:47.771903 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 403/813] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 17 11:47:47 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 11:47:47.831632 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-5bb071ef-4f1d-4dde-8afd-ccee99d64aa6 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:47.832132 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-5bb071ef-4f1d-4dde-8afd-ccee99d64aa6 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:47.838333 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5bb071ef-4f1d-4dde-8afd-ccee99d64aa6 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:47.838838 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5bb071ef-4f1d-4dde-8afd-ccee99d64aa6 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:47.839734 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5bb071ef-4f1d-4dde-8afd-ccee99d64aa6 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:47.840177 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5bb071ef-4f1d-4dde-8afd-ccee99d64aa6 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:47.867934 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-5bb071ef-4f1d-4dde-8afd-ccee99d64aa6 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Going to try to terminate instance {{(pid=124845) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 11:47:48.050780 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-abe9f3c8-fd11-41a9-90d2-05bbc6b6ee79 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:48.050780 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-abe9f3c8-fd11-41a9-90d2-05bbc6b6ee79 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:48.051944 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-abe9f3c8-fd11-41a9-90d2-05bbc6b6ee79 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:48.051944 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-abe9f3c8-fd11-41a9-90d2-05bbc6b6ee79 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:48.052769 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-abe9f3c8-fd11-41a9-90d2-05bbc6b6ee79 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:48.053213 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-abe9f3c8-fd11-41a9-90d2-05bbc6b6ee79 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:48.174904 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-abe9f3c8-fd11-41a9-90d2-05bbc6b6ee79 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lazy-loading 'services' on Instance uuid 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:47:48.365084 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-5bb071ef-4f1d-4dde-8afd-ccee99d64aa6 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892" status: 204 len: 0 microversion: 2.1 time: 0.537804 Jun 17 11:47:48.369568 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 411/814] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 17 11:47:47 2022] DELETE /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 11:47:48.372892 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-e85105f5-32cc-46cc-b209-50b23365e49b req-99bea94c-084e-4171-af2d-3221b569f458 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907", "tag": "f866082a-76d6-466b-8c49-7a5068d4d87f"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:47:48.384098 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-e85105f5-32cc-46cc-b209-50b23365e49b req-99bea94c-084e-4171-af2d-3221b569f458 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:48.384802 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-e85105f5-32cc-46cc-b209-50b23365e49b req-99bea94c-084e-4171-af2d-3221b569f458 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:48.402642 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-e85105f5-32cc-46cc-b209-50b23365e49b req-99bea94c-084e-4171-af2d-3221b569f458 service nova] Creating event network-changed:f866082a-76d6-466b-8c49-7a5068d4d87f for instance 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 on hv-cinder-83716 Jun 17 11:47:48.409035 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-e85105f5-32cc-46cc-b209-50b23365e49b req-99bea94c-084e-4171-af2d-3221b569f458 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041472 Jun 17 11:47:48.410044 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 412/815] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:47:48.418238 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-d57cdf1e-d59c-444b-9671-b2790d459ff3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:48.419337 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-d57cdf1e-d59c-444b-9671-b2790d459ff3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:48.428436 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d57cdf1e-d59c-444b-9671-b2790d459ff3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:48.429372 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d57cdf1e-d59c-444b-9671-b2790d459ff3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:48.430502 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d57cdf1e-d59c-444b-9671-b2790d459ff3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:48.431602 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d57cdf1e-d59c-444b-9671-b2790d459ff3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:48.535620 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-abe9f3c8-fd11-41a9-90d2-05bbc6b6ee79 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments/382e54ac-75b5-4fbc-98bb-c2fe33077bb1" status: 202 len: 0 microversion: 2.1 time: 0.492957 Jun 17 11:47:48.535620 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 404/816] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Jun 17 11:47:48 2022] DELETE /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments/382e54ac-75b5-4fbc-98bb-c2fe33077bb1 => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 11:47:48.552475 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5635c429-f2e1-4eb7-aa18-794c288c31a5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:48.557754 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-5635c429-f2e1-4eb7-aa18-794c288c31a5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:48.565830 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5635c429-f2e1-4eb7-aa18-794c288c31a5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:48.566301 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5635c429-f2e1-4eb7-aa18-794c288c31a5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:48.567168 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5635c429-f2e1-4eb7-aa18-794c288c31a5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:48.576118 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5635c429-f2e1-4eb7-aa18-794c288c31a5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:48.669177 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-d57cdf1e-d59c-444b-9671-b2790d459ff3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:48.682256 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-d57cdf1e-d59c-444b-9671-b2790d459ff3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:48.688636 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-d57cdf1e-d59c-444b-9671-b2790d459ff3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:48.693806 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-d57cdf1e-d59c-444b-9671-b2790d459ff3 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1730 microversion: 2.20 time: 0.281873 Jun 17 11:47:48.696139 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 413/817] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:48 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1730 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:47:48.718403 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-45a66333-dde1-49d7-a84c-fe835144f679 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:48.721854 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-45a66333-dde1-49d7-a84c-fe835144f679 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:48.734796 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-45a66333-dde1-49d7-a84c-fe835144f679 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:48.738620 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-45a66333-dde1-49d7-a84c-fe835144f679 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:48.742272 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-45a66333-dde1-49d7-a84c-fe835144f679 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:48.742923 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-45a66333-dde1-49d7-a84c-fe835144f679 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:48.809276 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-45a66333-dde1-49d7-a84c-fe835144f679 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098788 Jun 17 11:47:48.815509 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5635c429-f2e1-4eb7-aa18-794c288c31a5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:48.816700 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 414/818] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 17 11:47:48 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:47:48.822634 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5635c429-f2e1-4eb7-aa18-794c288c31a5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892" status: 200 len: 1673 microversion: 2.1 time: 0.284175 Jun 17 11:47:48.823467 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 405/819] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:47:48 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 => generated 1673 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:47:49.714975 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a9f4020f-2164-4f88-a590-a29ff50091e0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:49.715614 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a9f4020f-2164-4f88-a590-a29ff50091e0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:49.723539 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a9f4020f-2164-4f88-a590-a29ff50091e0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:49.723995 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a9f4020f-2164-4f88-a590-a29ff50091e0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:49.724772 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a9f4020f-2164-4f88-a590-a29ff50091e0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:49.725293 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a9f4020f-2164-4f88-a590-a29ff50091e0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:49.746044 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=6,nova_cell1:INSERT=6 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:47:49.823325 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-45221105-04e0-4b2b-9481-e449dd931dad tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:49.824402 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-45221105-04e0-4b2b-9481-e449dd931dad tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:49.826591 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=58 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:47:49.831921 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-45221105-04e0-4b2b-9481-e449dd931dad tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:49.832382 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-45221105-04e0-4b2b-9481-e449dd931dad tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:49.833271 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-45221105-04e0-4b2b-9481-e449dd931dad tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:49.835087 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-45221105-04e0-4b2b-9481-e449dd931dad tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:49.867265 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a9f4020f-2164-4f88-a590-a29ff50091e0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:49.867613 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-45221105-04e0-4b2b-9481-e449dd931dad tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048205 Jun 17 11:47:49.868197 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 406/820] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 17 11:47:49 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:47:49.872794 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c5c302b0-ae80-46b5-9617-b4d54e939a03 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:49.873405 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c5c302b0-ae80-46b5-9617-b4d54e939a03 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:49.875568 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a9f4020f-2164-4f88-a590-a29ff50091e0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:49.877788 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a9f4020f-2164-4f88-a590-a29ff50091e0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:49.879165 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a9f4020f-2164-4f88-a590-a29ff50091e0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1730 microversion: 2.20 time: 0.168152 Jun 17 11:47:49.879761 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 415/821] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:49 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:47:49.880719 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c5c302b0-ae80-46b5-9617-b4d54e939a03 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:49.881181 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c5c302b0-ae80-46b5-9617-b4d54e939a03 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:49.882054 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c5c302b0-ae80-46b5-9617-b4d54e939a03 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:49.882580 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c5c302b0-ae80-46b5-9617-b4d54e939a03 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:50.015393 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c5c302b0-ae80-46b5-9617-b4d54e939a03 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:50.023672 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c5c302b0-ae80-46b5-9617-b4d54e939a03 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892" status: 200 len: 1673 microversion: 2.1 time: 0.154484 Jun 17 11:47:50.024359 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 407/822] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:47:49 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:47:50.880086 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-1e38126c-8c20-4c85-af17-194383000033 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:50.881770 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-1e38126c-8c20-4c85-af17-194383000033 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:50.890515 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1e38126c-8c20-4c85-af17-194383000033 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:50.891119 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1e38126c-8c20-4c85-af17-194383000033 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:50.891942 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1e38126c-8c20-4c85-af17-194383000033 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:50.892387 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1e38126c-8c20-4c85-af17-194383000033 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:50.899667 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ffeadfb6-850d-4ae1-9916-03f835d872e0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:50.900283 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ffeadfb6-850d-4ae1-9916-03f835d872e0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:50.907263 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ffeadfb6-850d-4ae1-9916-03f835d872e0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:50.908007 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ffeadfb6-850d-4ae1-9916-03f835d872e0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:50.909699 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ffeadfb6-850d-4ae1-9916-03f835d872e0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:50.910300 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ffeadfb6-850d-4ae1-9916-03f835d872e0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:50.952266 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-1e38126c-8c20-4c85-af17-194383000033 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076427 Jun 17 11:47:50.962390 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 416/823] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 17 11:47:50 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:47:51.042118 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-500f0d08-665b-40d9-b67f-a250aa7eb254 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:51.042821 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-500f0d08-665b-40d9-b67f-a250aa7eb254 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:51.053731 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-500f0d08-665b-40d9-b67f-a250aa7eb254 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:51.054468 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-500f0d08-665b-40d9-b67f-a250aa7eb254 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:51.055188 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-500f0d08-665b-40d9-b67f-a250aa7eb254 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:51.056172 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-500f0d08-665b-40d9-b67f-a250aa7eb254 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:51.163118 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ffeadfb6-850d-4ae1-9916-03f835d872e0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:51.174984 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ffeadfb6-850d-4ae1-9916-03f835d872e0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:51.177592 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ffeadfb6-850d-4ae1-9916-03f835d872e0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:51.180035 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ffeadfb6-850d-4ae1-9916-03f835d872e0 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1730 microversion: 2.20 time: 0.284451 Jun 17 11:47:51.191103 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 408/824] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:50 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1730 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:47:51.256705 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-500f0d08-665b-40d9-b67f-a250aa7eb254 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:51.284237 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-500f0d08-665b-40d9-b67f-a250aa7eb254 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892" status: 200 len: 1673 microversion: 2.1 time: 0.246465 Jun 17 11:47:51.285062 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 417/825] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:47:51 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 => generated 1673 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:47:51.973166 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5fcfa8e0-f001-4daa-9e27-84418b8c0c4b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:51.974550 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-5fcfa8e0-f001-4daa-9e27-84418b8c0c4b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:51.983142 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5fcfa8e0-f001-4daa-9e27-84418b8c0c4b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:51.983793 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5fcfa8e0-f001-4daa-9e27-84418b8c0c4b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:51.984722 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5fcfa8e0-f001-4daa-9e27-84418b8c0c4b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:51.985322 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5fcfa8e0-f001-4daa-9e27-84418b8c0c4b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:52.049689 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5fcfa8e0-f001-4daa-9e27-84418b8c0c4b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080926 Jun 17 11:47:52.052032 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 409/826] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 17 11:47:51 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:47:52.204261 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-bc6cecac-6e4c-4cc0-a1d4-b88f6df5a51b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:52.204924 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-bc6cecac-6e4c-4cc0-a1d4-b88f6df5a51b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:52.212909 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bc6cecac-6e4c-4cc0-a1d4-b88f6df5a51b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:52.213365 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bc6cecac-6e4c-4cc0-a1d4-b88f6df5a51b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:52.214161 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bc6cecac-6e4c-4cc0-a1d4-b88f6df5a51b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:52.214627 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bc6cecac-6e4c-4cc0-a1d4-b88f6df5a51b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:52.306923 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-351c037f-39c2-4f36-a72d-6e6f3ca8b9f9 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:52.308312 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-351c037f-39c2-4f36-a72d-6e6f3ca8b9f9 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:52.337171 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-351c037f-39c2-4f36-a72d-6e6f3ca8b9f9 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:52.338103 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-351c037f-39c2-4f36-a72d-6e6f3ca8b9f9 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:52.339705 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-351c037f-39c2-4f36-a72d-6e6f3ca8b9f9 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:52.340505 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-351c037f-39c2-4f36-a72d-6e6f3ca8b9f9 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:52.409099 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-bc6cecac-6e4c-4cc0-a1d4-b88f6df5a51b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:52.423330 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-bc6cecac-6e4c-4cc0-a1d4-b88f6df5a51b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:52.426472 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-bc6cecac-6e4c-4cc0-a1d4-b88f6df5a51b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:52.428327 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-bc6cecac-6e4c-4cc0-a1d4-b88f6df5a51b tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1730 microversion: 2.20 time: 0.228086 Jun 17 11:47:52.429393 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 418/827] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:52 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1730 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:47:52.584592 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-351c037f-39c2-4f36-a72d-6e6f3ca8b9f9 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:52.598179 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-351c037f-39c2-4f36-a72d-6e6f3ca8b9f9 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892" status: 200 len: 1673 microversion: 2.1 time: 0.298786 Jun 17 11:47:52.603996 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 410/828] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:47:52 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 => generated 1673 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:47:53.279293 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4ea18e25-34a1-4766-939c-f0fb2371a109 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:53.279293 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4ea18e25-34a1-4766-939c-f0fb2371a109 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:53.279293 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4ea18e25-34a1-4766-939c-f0fb2371a109 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:53.279293 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4ea18e25-34a1-4766-939c-f0fb2371a109 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:53.281440 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4ea18e25-34a1-4766-939c-f0fb2371a109 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:53.281440 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4ea18e25-34a1-4766-939c-f0fb2371a109 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:53.281440 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4ea18e25-34a1-4766-939c-f0fb2371a109 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044884 Jun 17 11:47:53.281440 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 419/829] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 17 11:47:53 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:47:53.462132 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5b062431-e90a-4881-82ee-3e7f992ed633 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:53.463053 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-5b062431-e90a-4881-82ee-3e7f992ed633 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:53.471348 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5b062431-e90a-4881-82ee-3e7f992ed633 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:53.471982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5b062431-e90a-4881-82ee-3e7f992ed633 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:53.472816 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5b062431-e90a-4881-82ee-3e7f992ed633 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:53.473308 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5b062431-e90a-4881-82ee-3e7f992ed633 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:53.623720 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4ff90f5a-e32e-4753-b699-296a33440a14 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:53.625703 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4ff90f5a-e32e-4753-b699-296a33440a14 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:53.632914 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5b062431-e90a-4881-82ee-3e7f992ed633 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:53.640266 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4ff90f5a-e32e-4753-b699-296a33440a14 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:53.643073 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4ff90f5a-e32e-4753-b699-296a33440a14 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:53.644112 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4ff90f5a-e32e-4753-b699-296a33440a14 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:53.644574 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4ff90f5a-e32e-4753-b699-296a33440a14 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:53.652575 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5b062431-e90a-4881-82ee-3e7f992ed633 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:53.655123 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5b062431-e90a-4881-82ee-3e7f992ed633 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:53.656704 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5b062431-e90a-4881-82ee-3e7f992ed633 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1730 microversion: 2.20 time: 0.199023 Jun 17 11:47:53.657601 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 411/830] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:53 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1730 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:47:53.792636 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-4ff90f5a-e32e-4753-b699-296a33440a14 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:53.801377 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4ff90f5a-e32e-4753-b699-296a33440a14 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892" status: 200 len: 1673 microversion: 2.1 time: 0.185133 Jun 17 11:47:53.801963 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 420/831] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:47:53 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 => generated 1673 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:47:54.224860 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-90f6724a-b181-4b48-9594-355543a786eb tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:54.225766 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-90f6724a-b181-4b48-9594-355543a786eb tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:54.232364 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-90f6724a-b181-4b48-9594-355543a786eb tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:54.232816 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-90f6724a-b181-4b48-9594-355543a786eb tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:54.233610 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-90f6724a-b181-4b48-9594-355543a786eb tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:54.234055 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-90f6724a-b181-4b48-9594-355543a786eb tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:54.266607 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-90f6724a-b181-4b48-9594-355543a786eb tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045981 Jun 17 11:47:54.267188 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 412/832] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 17 11:47:54 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:47:54.678047 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-26947991-db66-4f1a-b213-02fdaac8eaca tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:54.678980 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-26947991-db66-4f1a-b213-02fdaac8eaca tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:54.688359 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-26947991-db66-4f1a-b213-02fdaac8eaca tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:54.689328 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-26947991-db66-4f1a-b213-02fdaac8eaca tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:54.698474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-26947991-db66-4f1a-b213-02fdaac8eaca tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:54.703562 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-26947991-db66-4f1a-b213-02fdaac8eaca tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:54.824163 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-17b2c5e3-dd20-4544-bc02-a1faaa1844db tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:54.834623 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-17b2c5e3-dd20-4544-bc02-a1faaa1844db tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:54.835109 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-17b2c5e3-dd20-4544-bc02-a1faaa1844db tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:54.835925 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-17b2c5e3-dd20-4544-bc02-a1faaa1844db tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:54.837281 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-17b2c5e3-dd20-4544-bc02-a1faaa1844db tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:54.838047 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-17b2c5e3-dd20-4544-bc02-a1faaa1844db tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:54.940792 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-26947991-db66-4f1a-b213-02fdaac8eaca tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:54.966835 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-26947991-db66-4f1a-b213-02fdaac8eaca tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:54.969924 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-26947991-db66-4f1a-b213-02fdaac8eaca tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:54.972146 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-26947991-db66-4f1a-b213-02fdaac8eaca tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1730 microversion: 2.20 time: 0.298820 Jun 17 11:47:54.972796 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 421/833] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:54 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1730 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:47:55.060573 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-17b2c5e3-dd20-4544-bc02-a1faaa1844db tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:55.075019 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-17b2c5e3-dd20-4544-bc02-a1faaa1844db tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892" status: 200 len: 1673 microversion: 2.1 time: 0.258372 Jun 17 11:47:55.076040 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 413/834] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:47:54 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 => generated 1673 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:47:55.287764 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2f8b8d47-8352-4cac-8d41-4148d329b5d8 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:55.287764 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2f8b8d47-8352-4cac-8d41-4148d329b5d8 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:55.295754 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2f8b8d47-8352-4cac-8d41-4148d329b5d8 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:55.296202 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2f8b8d47-8352-4cac-8d41-4148d329b5d8 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:55.296983 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2f8b8d47-8352-4cac-8d41-4148d329b5d8 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:55.297412 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2f8b8d47-8352-4cac-8d41-4148d329b5d8 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:55.361735 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2f8b8d47-8352-4cac-8d41-4148d329b5d8 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087244 Jun 17 11:47:55.362992 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 422/835] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 17 11:47:55 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:47:55.991402 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2a39326a-ba34-4a4e-93b8-f31e22b5a353 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:55.992837 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-2a39326a-ba34-4a4e-93b8-f31e22b5a353 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:55.999844 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2a39326a-ba34-4a4e-93b8-f31e22b5a353 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:56.000631 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2a39326a-ba34-4a4e-93b8-f31e22b5a353 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:56.001606 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2a39326a-ba34-4a4e-93b8-f31e22b5a353 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:56.002859 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2a39326a-ba34-4a4e-93b8-f31e22b5a353 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:56.099624 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-3298d8b9-a699-4198-8f6b-e83d6a815d80 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:56.103312 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-3298d8b9-a699-4198-8f6b-e83d6a815d80 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:56.108528 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3298d8b9-a699-4198-8f6b-e83d6a815d80 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:56.109225 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3298d8b9-a699-4198-8f6b-e83d6a815d80 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:56.110178 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3298d8b9-a699-4198-8f6b-e83d6a815d80 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:56.110768 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3298d8b9-a699-4198-8f6b-e83d6a815d80 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:56.173491 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2a39326a-ba34-4a4e-93b8-f31e22b5a353 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:56.176729 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:47:56.188313 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2a39326a-ba34-4a4e-93b8-f31e22b5a353 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:56.191348 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2a39326a-ba34-4a4e-93b8-f31e22b5a353 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:56.193042 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2a39326a-ba34-4a4e-93b8-f31e22b5a353 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1730 microversion: 2.20 time: 0.206322 Jun 17 11:47:56.193746 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 414/836] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:55 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1730 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:47:56.300865 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-3298d8b9-a699-4198-8f6b-e83d6a815d80 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:56.309321 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-3298d8b9-a699-4198-8f6b-e83d6a815d80 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892" status: 200 len: 1673 microversion: 2.1 time: 0.213755 Jun 17 11:47:56.309907 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 423/837] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:47:56 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 => generated 1673 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:47:56.378805 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6e463440-b555-4b13-b275-dfcbbe6bd68b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:56.379879 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-6e463440-b555-4b13-b275-dfcbbe6bd68b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:56.386952 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6e463440-b555-4b13-b275-dfcbbe6bd68b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:56.387443 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6e463440-b555-4b13-b275-dfcbbe6bd68b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:56.388393 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6e463440-b555-4b13-b275-dfcbbe6bd68b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:56.388845 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6e463440-b555-4b13-b275-dfcbbe6bd68b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:56.422550 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-6e463440-b555-4b13-b275-dfcbbe6bd68b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051713 Jun 17 11:47:56.423149 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 415/838] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 17 11:47:56 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:47:57.214013 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ed4abc46-ea06-48ff-9940-fc9ed7802e9f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:57.214625 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-ed4abc46-ea06-48ff-9940-fc9ed7802e9f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:57.222506 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ed4abc46-ea06-48ff-9940-fc9ed7802e9f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:57.223252 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ed4abc46-ea06-48ff-9940-fc9ed7802e9f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:57.224417 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ed4abc46-ea06-48ff-9940-fc9ed7802e9f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:57.225003 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ed4abc46-ea06-48ff-9940-fc9ed7802e9f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:57.329424 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-0424a1a6-9a56-4925-8d2c-ca4a6c4a4cb1 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:57.330826 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-0424a1a6-9a56-4925-8d2c-ca4a6c4a4cb1 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:57.343527 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0424a1a6-9a56-4925-8d2c-ca4a6c4a4cb1 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:57.344462 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0424a1a6-9a56-4925-8d2c-ca4a6c4a4cb1 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:57.346645 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0424a1a6-9a56-4925-8d2c-ca4a6c4a4cb1 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:57.347662 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0424a1a6-9a56-4925-8d2c-ca4a6c4a4cb1 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:57.409404 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ed4abc46-ea06-48ff-9940-fc9ed7802e9f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:57.418611 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ed4abc46-ea06-48ff-9940-fc9ed7802e9f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:57.420577 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ed4abc46-ea06-48ff-9940-fc9ed7802e9f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:57.421893 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-ed4abc46-ea06-48ff-9940-fc9ed7802e9f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1730 microversion: 2.20 time: 0.212978 Jun 17 11:47:57.423416 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 424/839] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:57 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1730 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:47:57.440758 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-fc42f7de-cb14-4524-a4b7-beed6bcf7e47 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:57.443110 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-fc42f7de-cb14-4524-a4b7-beed6bcf7e47 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:57.450955 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fc42f7de-cb14-4524-a4b7-beed6bcf7e47 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:57.451634 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fc42f7de-cb14-4524-a4b7-beed6bcf7e47 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:57.455077 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fc42f7de-cb14-4524-a4b7-beed6bcf7e47 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:57.455077 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fc42f7de-cb14-4524-a4b7-beed6bcf7e47 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:57.492414 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-fc42f7de-cb14-4524-a4b7-beed6bcf7e47 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060917 Jun 17 11:47:57.495199 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 425/840] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 17 11:47:57 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:47:57.573192 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-0424a1a6-9a56-4925-8d2c-ca4a6c4a4cb1 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:57.579613 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-0424a1a6-9a56-4925-8d2c-ca4a6c4a4cb1 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892" status: 200 len: 1673 microversion: 2.1 time: 0.254937 Jun 17 11:47:57.583336 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 416/841] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:47:57 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 => generated 1673 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:47:58.443811 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-696f3f60-8297-441e-98ca-434f1b046eb1 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:58.444738 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-696f3f60-8297-441e-98ca-434f1b046eb1 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:58.453550 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-696f3f60-8297-441e-98ca-434f1b046eb1 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:58.454084 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-696f3f60-8297-441e-98ca-434f1b046eb1 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:58.455177 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-696f3f60-8297-441e-98ca-434f1b046eb1 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:58.455707 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-696f3f60-8297-441e-98ca-434f1b046eb1 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:58.506130 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f6771285-486d-443d-b96a-f4afd03a2798 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:58.507135 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f6771285-486d-443d-b96a-f4afd03a2798 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:58.514839 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f6771285-486d-443d-b96a-f4afd03a2798 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:58.515714 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f6771285-486d-443d-b96a-f4afd03a2798 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:58.517185 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f6771285-486d-443d-b96a-f4afd03a2798 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:58.517928 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f6771285-486d-443d-b96a-f4afd03a2798 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:58.553896 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f6771285-486d-443d-b96a-f4afd03a2798 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052780 Jun 17 11:47:58.560557 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 417/842] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 17 11:47:58 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:47:58.602791 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1d8dcc02-9fd4-4fb1-8a4c-a8ccfc76cf33 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:58.603835 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-1d8dcc02-9fd4-4fb1-8a4c-a8ccfc76cf33 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:58.626077 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1d8dcc02-9fd4-4fb1-8a4c-a8ccfc76cf33 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:58.631609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1d8dcc02-9fd4-4fb1-8a4c-a8ccfc76cf33 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:58.631609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1d8dcc02-9fd4-4fb1-8a4c-a8ccfc76cf33 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:58.631609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1d8dcc02-9fd4-4fb1-8a4c-a8ccfc76cf33 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:58.665275 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-696f3f60-8297-441e-98ca-434f1b046eb1 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:58.683536 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-696f3f60-8297-441e-98ca-434f1b046eb1 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:58.685243 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-696f3f60-8297-441e-98ca-434f1b046eb1 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:58.695245 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-696f3f60-8297-441e-98ca-434f1b046eb1 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1730 microversion: 2.20 time: 0.255284 Jun 17 11:47:58.715270 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 426/843] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:58 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1730 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:47:58.823334 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-1d8dcc02-9fd4-4fb1-8a4c-a8ccfc76cf33 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:58.831938 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-1d8dcc02-9fd4-4fb1-8a4c-a8ccfc76cf33 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892" status: 200 len: 1673 microversion: 2.1 time: 0.237179 Jun 17 11:47:58.832531 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 418/844] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:47:58 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 => generated 1673 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:47:59.568681 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0c85e6d9-b663-4f02-b016-9548ae0eb61f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:59.569615 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0c85e6d9-b663-4f02-b016-9548ae0eb61f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:59.575853 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0c85e6d9-b663-4f02-b016-9548ae0eb61f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:59.576293 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0c85e6d9-b663-4f02-b016-9548ae0eb61f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:59.577089 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0c85e6d9-b663-4f02-b016-9548ae0eb61f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:59.577519 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0c85e6d9-b663-4f02-b016-9548ae0eb61f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:59.584906 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-553c816e-fe57-435c-86b6-3fc841ef9d51 req-b17e32a3-c014-49bf-a6e8-d15e68ccee58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ed47de2-4bfc-4635-8345-47b1cc369892", "name": "network-vif-unplugged", "status": "completed", "tag": "4272e231-ff05-439d-a324-ff813464d4bb"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:47:59.595400 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-553c816e-fe57-435c-86b6-3fc841ef9d51 req-b17e32a3-c014-49bf-a6e8-d15e68ccee58 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:59.596787 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-553c816e-fe57-435c-86b6-3fc841ef9d51 req-b17e32a3-c014-49bf-a6e8-d15e68ccee58 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:59.609934 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-553c816e-fe57-435c-86b6-3fc841ef9d51 req-b17e32a3-c014-49bf-a6e8-d15e68ccee58 service nova] Creating event network-vif-unplugged:4272e231-ff05-439d-a324-ff813464d4bb for instance 2ed47de2-4bfc-4635-8345-47b1cc369892 on hv-cinder-83716 Jun 17 11:47:59.613984 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0c85e6d9-b663-4f02-b016-9548ae0eb61f tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049804 Jun 17 11:47:59.617879 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 427/845] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 17 11:47:59 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:47:59.618059 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-553c816e-fe57-435c-86b6-3fc841ef9d51 req-b17e32a3-c014-49bf-a6e8-d15e68ccee58 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035508 Jun 17 11:47:59.618059 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 419/846] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:47:59.729195 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f4af3191-aa8b-44f1-9659-511740238208 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:59.729826 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f4af3191-aa8b-44f1-9659-511740238208 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:59.747295 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f4af3191-aa8b-44f1-9659-511740238208 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:59.748141 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f4af3191-aa8b-44f1-9659-511740238208 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:59.749193 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f4af3191-aa8b-44f1-9659-511740238208 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:59.749993 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f4af3191-aa8b-44f1-9659-511740238208 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:59.850870 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3089ed4d-7d9b-4361-acd7-026627407303 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:47:59.856899 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-3089ed4d-7d9b-4361-acd7-026627407303 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:47:59.858211 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3089ed4d-7d9b-4361-acd7-026627407303 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:59.858688 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3089ed4d-7d9b-4361-acd7-026627407303 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:59.859489 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3089ed4d-7d9b-4361-acd7-026627407303 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:47:59.859930 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3089ed4d-7d9b-4361-acd7-026627407303 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:47:59.893113 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f4af3191-aa8b-44f1-9659-511740238208 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:59.905926 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f4af3191-aa8b-44f1-9659-511740238208 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:59.907440 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f4af3191-aa8b-44f1-9659-511740238208 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:47:59.909428 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f4af3191-aa8b-44f1-9659-511740238208 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1730 microversion: 2.20 time: 0.187117 Jun 17 11:47:59.910170 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 428/847] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:47:59 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:48:00.013020 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3089ed4d-7d9b-4361-acd7-026627407303 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:00.023674 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-3089ed4d-7d9b-4361-acd7-026627407303 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892" status: 200 len: 1673 microversion: 2.1 time: 0.177767 Jun 17 11:48:00.024530 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 420/848] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:47:59 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 => generated 1673 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:48:00.626365 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4e3e403f-08b0-4d0e-a8d1-a278ad901339 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:00.627651 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4e3e403f-08b0-4d0e-a8d1-a278ad901339 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:00.634628 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4e3e403f-08b0-4d0e-a8d1-a278ad901339 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:00.635103 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4e3e403f-08b0-4d0e-a8d1-a278ad901339 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:00.635897 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4e3e403f-08b0-4d0e-a8d1-a278ad901339 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:00.636333 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4e3e403f-08b0-4d0e-a8d1-a278ad901339 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:00.667532 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4e3e403f-08b0-4d0e-a8d1-a278ad901339 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045961 Jun 17 11:48:00.668121 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 429/849] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 17 11:48:00 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:48:00.927993 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6a06e6c6-ada3-4399-bfb1-8a60c3269fa5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:00.928626 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-6a06e6c6-ada3-4399-bfb1-8a60c3269fa5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:00.935698 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6a06e6c6-ada3-4399-bfb1-8a60c3269fa5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:00.936178 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6a06e6c6-ada3-4399-bfb1-8a60c3269fa5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:00.936932 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6a06e6c6-ada3-4399-bfb1-8a60c3269fa5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:00.937378 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6a06e6c6-ada3-4399-bfb1-8a60c3269fa5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:01.043756 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-53df9dfe-ac6c-46f7-825d-7a02931f07dd tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:01.044366 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-53df9dfe-ac6c-46f7-825d-7a02931f07dd tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:01.051948 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-53df9dfe-ac6c-46f7-825d-7a02931f07dd tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:01.052508 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-53df9dfe-ac6c-46f7-825d-7a02931f07dd tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:01.053392 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-53df9dfe-ac6c-46f7-825d-7a02931f07dd tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:01.054069 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-53df9dfe-ac6c-46f7-825d-7a02931f07dd tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:01.076818 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-6a06e6c6-ada3-4399-bfb1-8a60c3269fa5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:01.090773 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-6a06e6c6-ada3-4399-bfb1-8a60c3269fa5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:01.092317 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-6a06e6c6-ada3-4399-bfb1-8a60c3269fa5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:01.093534 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-6a06e6c6-ada3-4399-bfb1-8a60c3269fa5 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1730 microversion: 2.20 time: 0.169846 Jun 17 11:48:01.094096 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 421/850] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:48:00 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:48:01.514626 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-53df9dfe-ac6c-46f7-825d-7a02931f07dd tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:01.523779 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-53df9dfe-ac6c-46f7-825d-7a02931f07dd tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892" status: 200 len: 1673 microversion: 2.1 time: 0.483733 Jun 17 11:48:01.524388 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 430/851] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:01 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 => generated 1673 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:48:01.679990 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1f088254-d769-482c-8b2c-9cf6eda271df tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:01.680967 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-1f088254-d769-482c-8b2c-9cf6eda271df tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:01.687122 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1f088254-d769-482c-8b2c-9cf6eda271df tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:01.687599 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1f088254-d769-482c-8b2c-9cf6eda271df tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:01.688465 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1f088254-d769-482c-8b2c-9cf6eda271df tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:01.688897 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1f088254-d769-482c-8b2c-9cf6eda271df tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:01.719742 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-1f088254-d769-482c-8b2c-9cf6eda271df tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043597 Jun 17 11:48:01.720256 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 422/852] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 17 11:48:01 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:48:02.116623 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2edeca8e-162e-4a19-ae37-bff90cdaf3ca tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:02.117288 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2edeca8e-162e-4a19-ae37-bff90cdaf3ca tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:02.123892 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2edeca8e-162e-4a19-ae37-bff90cdaf3ca tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:02.124348 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2edeca8e-162e-4a19-ae37-bff90cdaf3ca tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:02.125373 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2edeca8e-162e-4a19-ae37-bff90cdaf3ca tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:02.125805 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2edeca8e-162e-4a19-ae37-bff90cdaf3ca tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:02.283890 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2edeca8e-162e-4a19-ae37-bff90cdaf3ca tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:02.288929 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2edeca8e-162e-4a19-ae37-bff90cdaf3ca tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:02.288929 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2edeca8e-162e-4a19-ae37-bff90cdaf3ca tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:02.288929 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2edeca8e-162e-4a19-ae37-bff90cdaf3ca tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1730 microversion: 2.20 time: 0.175523 Jun 17 11:48:02.289393 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 431/853] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:48:02 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:48:02.546153 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-062dc737-0318-460f-9c31-3adf3f3755f5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:02.547058 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-062dc737-0318-460f-9c31-3adf3f3755f5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:02.559589 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-062dc737-0318-460f-9c31-3adf3f3755f5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:02.560385 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-062dc737-0318-460f-9c31-3adf3f3755f5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:02.561765 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-062dc737-0318-460f-9c31-3adf3f3755f5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:02.562557 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-062dc737-0318-460f-9c31-3adf3f3755f5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:02.724667 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-062dc737-0318-460f-9c31-3adf3f3755f5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:02.732665 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-062dc737-0318-460f-9c31-3adf3f3755f5 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892" status: 200 len: 1673 microversion: 2.1 time: 0.193820 Jun 17 11:48:02.733247 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 423/854] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:02 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 => generated 1673 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:48:02.733459 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8b150bce-343b-49c3-9c76-4309c9556a8e tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:02.735298 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-8b150bce-343b-49c3-9c76-4309c9556a8e tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:02.746440 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8b150bce-343b-49c3-9c76-4309c9556a8e tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:02.747251 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8b150bce-343b-49c3-9c76-4309c9556a8e tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:02.748704 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8b150bce-343b-49c3-9c76-4309c9556a8e tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:02.749483 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8b150bce-343b-49c3-9c76-4309c9556a8e tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:02.756885 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=100 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:48:02.790398 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-8b150bce-343b-49c3-9c76-4309c9556a8e tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062377 Jun 17 11:48:02.791067 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 432/855] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 17 11:48:02 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:48:03.307555 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c097a5e5-5cf3-4693-85bb-76e2a247220d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:03.308172 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c097a5e5-5cf3-4693-85bb-76e2a247220d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:03.314567 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c097a5e5-5cf3-4693-85bb-76e2a247220d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:03.315046 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c097a5e5-5cf3-4693-85bb-76e2a247220d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:03.315863 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c097a5e5-5cf3-4693-85bb-76e2a247220d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:03.316350 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c097a5e5-5cf3-4693-85bb-76e2a247220d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:03.453932 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c097a5e5-5cf3-4693-85bb-76e2a247220d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:03.463484 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c097a5e5-5cf3-4693-85bb-76e2a247220d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:03.465025 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c097a5e5-5cf3-4693-85bb-76e2a247220d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:03.466392 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c097a5e5-5cf3-4693-85bb-76e2a247220d tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1730 microversion: 2.20 time: 0.163012 Jun 17 11:48:03.466966 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 424/856] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:48:03 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:48:03.751132 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b9c95d25-b4f1-4e5c-bee3-3dcb21698e1e tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:03.754435 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b9c95d25-b4f1-4e5c-bee3-3dcb21698e1e tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:03.760576 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b9c95d25-b4f1-4e5c-bee3-3dcb21698e1e tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:03.761237 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b9c95d25-b4f1-4e5c-bee3-3dcb21698e1e tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:03.762036 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b9c95d25-b4f1-4e5c-bee3-3dcb21698e1e tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:03.762477 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b9c95d25-b4f1-4e5c-bee3-3dcb21698e1e tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:03.803098 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b0e2bcdf-c0f8-4fd1-84c7-5f6be580124b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:03.804063 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b0e2bcdf-c0f8-4fd1-84c7-5f6be580124b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:03.810662 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b0e2bcdf-c0f8-4fd1-84c7-5f6be580124b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:03.811135 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b0e2bcdf-c0f8-4fd1-84c7-5f6be580124b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:03.811993 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b0e2bcdf-c0f8-4fd1-84c7-5f6be580124b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:03.812435 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b0e2bcdf-c0f8-4fd1-84c7-5f6be580124b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:03.845203 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b0e2bcdf-c0f8-4fd1-84c7-5f6be580124b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046946 Jun 17 11:48:03.846150 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 425/857] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 17 11:48:03 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:48:03.898543 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b9c95d25-b4f1-4e5c-bee3-3dcb21698e1e tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:03.906401 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b9c95d25-b4f1-4e5c-bee3-3dcb21698e1e tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892" status: 200 len: 1673 microversion: 2.1 time: 0.159560 Jun 17 11:48:03.906994 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 433/858] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:03 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:48:04.485101 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-572e75e8-fdcb-4273-abf7-9f99da2ce94a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:04.485725 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-572e75e8-fdcb-4273-abf7-9f99da2ce94a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:04.492438 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-572e75e8-fdcb-4273-abf7-9f99da2ce94a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:04.492898 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-572e75e8-fdcb-4273-abf7-9f99da2ce94a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:04.493719 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-572e75e8-fdcb-4273-abf7-9f99da2ce94a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:04.494160 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-572e75e8-fdcb-4273-abf7-9f99da2ce94a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:04.631594 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-572e75e8-fdcb-4273-abf7-9f99da2ce94a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:04.639656 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-572e75e8-fdcb-4273-abf7-9f99da2ce94a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:04.641178 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-572e75e8-fdcb-4273-abf7-9f99da2ce94a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:04.642330 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-572e75e8-fdcb-4273-abf7-9f99da2ce94a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1730 microversion: 2.20 time: 0.161316 Jun 17 11:48:04.643445 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 426/859] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:48:04 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:48:04.857427 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-7017231a-e7a6-4295-b742-742714f896dd tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:04.858423 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-7017231a-e7a6-4295-b742-742714f896dd tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:04.866157 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7017231a-e7a6-4295-b742-742714f896dd tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:04.866643 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7017231a-e7a6-4295-b742-742714f896dd tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:04.867468 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7017231a-e7a6-4295-b742-742714f896dd tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:04.867924 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7017231a-e7a6-4295-b742-742714f896dd tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:04.899351 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-7017231a-e7a6-4295-b742-742714f896dd tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045856 Jun 17 11:48:04.899912 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 434/860] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 17 11:48:04 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:48:04.923222 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-7c840b93-7f4d-4c5a-b036-03210ddd8e3f tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:04.924568 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7c840b93-7f4d-4c5a-b036-03210ddd8e3f tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:04.931127 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7c840b93-7f4d-4c5a-b036-03210ddd8e3f tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:04.932001 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7c840b93-7f4d-4c5a-b036-03210ddd8e3f tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:04.932417 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7c840b93-7f4d-4c5a-b036-03210ddd8e3f tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:04.932938 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7c840b93-7f4d-4c5a-b036-03210ddd8e3f tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:05.064469 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7c840b93-7f4d-4c5a-b036-03210ddd8e3f tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:05.072244 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-7c840b93-7f4d-4c5a-b036-03210ddd8e3f tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892" status: 200 len: 1673 microversion: 2.1 time: 0.153104 Jun 17 11:48:05.072825 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 427/861] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:04 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:48:05.629098 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-e45af199-8506-41ab-bf30-d7302ac44fa2 req-883525b8-2035-4258-8e71-a0536ebae28f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4eb9c8c-b733-475e-b69e-279e9295ac4d", "name": "network-vif-plugged", "status": "completed", "tag": "f00e28a8-041d-4c99-8685-2e89673ad6b8"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:48:05.638853 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-e45af199-8506-41ab-bf30-d7302ac44fa2 req-883525b8-2035-4258-8e71-a0536ebae28f service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:05.639305 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-e45af199-8506-41ab-bf30-d7302ac44fa2 req-883525b8-2035-4258-8e71-a0536ebae28f service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:05.651785 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-e45af199-8506-41ab-bf30-d7302ac44fa2 req-883525b8-2035-4258-8e71-a0536ebae28f service nova] Creating event network-vif-plugged:f00e28a8-041d-4c99-8685-2e89673ad6b8 for instance f4eb9c8c-b733-475e-b69e-279e9295ac4d on hv-cinder-83716 Jun 17 11:48:05.657949 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-e45af199-8506-41ab-bf30-d7302ac44fa2 req-883525b8-2035-4258-8e71-a0536ebae28f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032936 Jun 17 11:48:05.659775 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 435/862] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:48:05.663228 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f45c46e1-bb1f-40f6-9141-254d4be05696 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:05.663228 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f45c46e1-bb1f-40f6-9141-254d4be05696 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:05.668587 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f45c46e1-bb1f-40f6-9141-254d4be05696 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:05.669032 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f45c46e1-bb1f-40f6-9141-254d4be05696 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:05.669855 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f45c46e1-bb1f-40f6-9141-254d4be05696 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:05.670288 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f45c46e1-bb1f-40f6-9141-254d4be05696 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:05.808526 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f45c46e1-bb1f-40f6-9141-254d4be05696 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:05.816557 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f45c46e1-bb1f-40f6-9141-254d4be05696 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:05.818110 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f45c46e1-bb1f-40f6-9141-254d4be05696 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:05.819289 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f45c46e1-bb1f-40f6-9141-254d4be05696 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1730 microversion: 2.20 time: 0.161954 Jun 17 11:48:05.829982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 428/863] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:48:05 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:48:05.913025 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-58becccc-e86f-4253-abb9-1fc2c37c81a5 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:05.914719 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-58becccc-e86f-4253-abb9-1fc2c37c81a5 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:05.928326 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-58becccc-e86f-4253-abb9-1fc2c37c81a5 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:05.928719 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-58becccc-e86f-4253-abb9-1fc2c37c81a5 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:05.929497 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-58becccc-e86f-4253-abb9-1fc2c37c81a5 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:05.929930 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-58becccc-e86f-4253-abb9-1fc2c37c81a5 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:05.992382 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-58becccc-e86f-4253-abb9-1fc2c37c81a5 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085138 Jun 17 11:48:05.993954 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 436/864] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 17 11:48:05 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:48:06.090936 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-cd6472c3-baab-485a-b0c6-c92ccbd741d4 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:06.091675 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-cd6472c3-baab-485a-b0c6-c92ccbd741d4 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:06.099522 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cd6472c3-baab-485a-b0c6-c92ccbd741d4 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:06.099979 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cd6472c3-baab-485a-b0c6-c92ccbd741d4 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:06.100956 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cd6472c3-baab-485a-b0c6-c92ccbd741d4 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:06.102183 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cd6472c3-baab-485a-b0c6-c92ccbd741d4 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:06.318603 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-cd6472c3-baab-485a-b0c6-c92ccbd741d4 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:06.326803 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-cd6472c3-baab-485a-b0c6-c92ccbd741d4 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892" status: 200 len: 1673 microversion: 2.1 time: 0.239930 Jun 17 11:48:06.327714 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 429/865] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:06 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 => generated 1673 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:48:06.839668 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-065801f8-289d-4d7c-83af-80324da397ef tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:06.841133 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-065801f8-289d-4d7c-83af-80324da397ef tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:06.851506 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-065801f8-289d-4d7c-83af-80324da397ef tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:06.852296 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-065801f8-289d-4d7c-83af-80324da397ef tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:06.853200 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-065801f8-289d-4d7c-83af-80324da397ef tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:06.853817 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-065801f8-289d-4d7c-83af-80324da397ef tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:06.862347 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-165f4609-99dc-4864-918e-c29289b7de2e req-f8e505fb-291c-4b52-82d3-8f73a3ce2bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ed47de2-4bfc-4635-8345-47b1cc369892", "name": "network-vif-deleted", "tag": "4272e231-ff05-439d-a324-ff813464d4bb"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:48:06.873450 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-165f4609-99dc-4864-918e-c29289b7de2e req-f8e505fb-291c-4b52-82d3-8f73a3ce2bc6 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:06.874397 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-165f4609-99dc-4864-918e-c29289b7de2e req-f8e505fb-291c-4b52-82d3-8f73a3ce2bc6 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:06.889035 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-165f4609-99dc-4864-918e-c29289b7de2e req-f8e505fb-291c-4b52-82d3-8f73a3ce2bc6 service nova] Creating event network-vif-deleted:4272e231-ff05-439d-a324-ff813464d4bb for instance 2ed47de2-4bfc-4635-8345-47b1cc369892 on hv-cinder-83716 Jun 17 11:48:06.895190 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-165f4609-99dc-4864-918e-c29289b7de2e req-f8e505fb-291c-4b52-82d3-8f73a3ce2bc6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041620 Jun 17 11:48:06.896311 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 430/866] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:48:07.002029 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-065801f8-289d-4d7c-83af-80324da397ef tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:07.006554 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-7e56b329-b0cf-47cf-91dd-a36863751db5 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:07.007130 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7e56b329-b0cf-47cf-91dd-a36863751db5 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:07.011549 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-065801f8-289d-4d7c-83af-80324da397ef tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:07.013304 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-065801f8-289d-4d7c-83af-80324da397ef tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:07.014211 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7e56b329-b0cf-47cf-91dd-a36863751db5 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:07.014581 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-065801f8-289d-4d7c-83af-80324da397ef tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1730 microversion: 2.20 time: 0.181318 Jun 17 11:48:07.014937 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7e56b329-b0cf-47cf-91dd-a36863751db5 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:07.015144 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 437/867] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:48:06 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:48:07.016019 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7e56b329-b0cf-47cf-91dd-a36863751db5 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:07.016583 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7e56b329-b0cf-47cf-91dd-a36863751db5 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:07.048042 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-7e56b329-b0cf-47cf-91dd-a36863751db5 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046623 Jun 17 11:48:07.048530 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 431/868] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 17 11:48:06 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 11:48:07.059276 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-592a8986-fa68-4ed0-80bb-8257aaa2073b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:07.059929 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-592a8986-fa68-4ed0-80bb-8257aaa2073b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:07.066987 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-592a8986-fa68-4ed0-80bb-8257aaa2073b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:07.067569 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-592a8986-fa68-4ed0-80bb-8257aaa2073b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:07.068471 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-592a8986-fa68-4ed0-80bb-8257aaa2073b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:07.069012 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-592a8986-fa68-4ed0-80bb-8257aaa2073b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:07.150059 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-592a8986-fa68-4ed0-80bb-8257aaa2073b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] HTTP exception thrown: Instance 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 is not attached to volume 382e54ac-75b5-4fbc-98bb-c2fe33077bb1 Jun 17 11:48:07.163387 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-592a8986-fa68-4ed0-80bb-8257aaa2073b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Request method failure captured: Jun 17 11:48:07.163387 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: request: DELETE /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments/382e54ac-75b5-4fbc-98bb-c2fe33077bb1 HTTP/1.1 Jun 17 11:48:07.163387 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jun 17 11:48:07.163387 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jun 17 11:48:07.163387 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Connection: close Jun 17 11:48:07.163387 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jun 17 11:48:07.163387 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jun 17 11:48:07.163387 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.45 Jun 17 11:48:07.163387 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jun 17 11:48:07.163387 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jun 17 11:48:07.163387 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABirGk2RfYmzw7qegPKIjQ7eUg6cjWeZ2xAgSpomfHJ9ABXAY5mOyNS8QXhJARYcrUNKtSNQ9GmJFo_YnZMVKPjavRCO22eESQ3P0C-zs_K0sgXmBwBM1R9j0s7S6XYNyAMxuos2-QWgYxSrjktMWqC9upSIkgE2j1lnjokuYX3PbVPz2s Jun 17 11:48:07.163387 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jun 17 11:48:07.163387 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jun 17 11:48:07.163387 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jun 17 11:48:07.163387 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jun 17 11:48:07.163387 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jun 17 11:48:07.163387 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jun 17 11:48:07.163387 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Id: 6466d6627209487ca62377eb7aa5d9e4 Jun 17 11:48:07.163387 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-TestMinimumBasicScenario-429386431 Jun 17 11:48:07.163387 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jun 17 11:48:07.163387 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jun 17 11:48:07.165142 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6466d6627209487ca62377eb7aa5d9e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6466d6627209487ca62377eb7aa5d9e4", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6466d6627209487ca62377eb7aa5d9e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6466d6627209487ca62377eb7aa5d9e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:48:07.165142 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-TestMinimumBasicScenario-429386431 Jun 17 11:48:07.165142 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: 6466d6627209487ca62377eb7aa5d9e4 Jun 17 11:48:07.165142 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-TestMinimumBasicScenario-429386431 Jun 17 11:48:07.165142 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User: tempest-TestMinimumBasicScenario-429386431-project Jun 17 11:48:07.165142 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jun 17 11:48:07.165142 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jun 17 11:48:07.165142 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Id: ac50aafcdf92434ba0ef7c8f42642ebb Jun 17 11:48:07.165142 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-TestMinimumBasicScenario-429386431-project Jun 17 11:48:07.165142 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: method: > Jun 17 11:48:07.165142 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: exception: Instance 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 is not attached to volume 382e54ac-75b5-4fbc-98bb-c2fe33077bb1 Jun 17 11:48:07.169056 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: action_args: {'server_id': '0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907', 'id': '382e54ac-75b5-4fbc-98bb-c2fe33077bb1'} Jun 17 11:48:07.169056 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:48:07.169056 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:07.169056 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 17 11:48:07.169056 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 17 11:48:07.169056 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 11:48:07.169056 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 11:48:07.169056 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 17 11:48:07.169056 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 17 11:48:07.169056 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 382e54ac-75b5-4fbc-98bb-c2fe33077bb1. Jun 17 11:48:07.169056 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:07.169056 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:07.169056 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:07.169056 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:07.169056 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:07.169056 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:07.169056 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:48:07.169056 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:48:07.169056 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:48:07.171000 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:48:07.171000 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 17 11:48:07.171000 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 17 11:48:07.171000 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 is not attached to volume 382e54ac-75b5-4fbc-98bb-c2fe33077bb1 Jun 17 11:48:07.171000 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:07.171000 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:07.171000 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:07.171000 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:07.171000 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:07.171000 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:07.171000 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:48:07.171000 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:48:07.171000 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 is not attached to volume 382e54ac-75b5-4fbc-98bb-c2fe33077bb1 Jun 17 11:48:07.171000 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:07.171000 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-592a8986-fa68-4ed0-80bb-8257aaa2073b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Returning 404 to user: Instance 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 is not attached to volume 382e54ac-75b5-4fbc-98bb-c2fe33077bb1 {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:48:07.172633 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-592a8986-fa68-4ed0-80bb-8257aaa2073b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments/382e54ac-75b5-4fbc-98bb-c2fe33077bb1" status: 404 len: 154 microversion: 2.1 time: 0.109908 Jun 17 11:48:07.172633 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 438/869] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Jun 17 11:48:07 2022] DELETE /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907/os-volume_attachments/382e54ac-75b5-4fbc-98bb-c2fe33077bb1 => generated 154 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:48:07.344666 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-233f6149-6a91-4e11-9a2e-084cc6732758 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:07.345500 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-233f6149-6a91-4e11-9a2e-084cc6732758 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:07.355597 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-233f6149-6a91-4e11-9a2e-084cc6732758 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:07.356059 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-233f6149-6a91-4e11-9a2e-084cc6732758 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:07.357987 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-233f6149-6a91-4e11-9a2e-084cc6732758 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:07.357987 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-233f6149-6a91-4e11-9a2e-084cc6732758 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:07.432177 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-233f6149-6a91-4e11-9a2e-084cc6732758 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:07.434691 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=100 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:48:07.441874 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-233f6149-6a91-4e11-9a2e-084cc6732758 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892" status: 200 len: 1322 microversion: 2.1 time: 0.101090 Jun 17 11:48:07.442641 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 432/870] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:07 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 => generated 1322 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:48:08.042725 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-1b86639d-b663-44a5-8f8a-62f7fa9cae70 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:08.043835 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-1b86639d-b663-44a5-8f8a-62f7fa9cae70 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:08.056567 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1b86639d-b663-44a5-8f8a-62f7fa9cae70 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:08.057455 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1b86639d-b663-44a5-8f8a-62f7fa9cae70 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:08.058868 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1b86639d-b663-44a5-8f8a-62f7fa9cae70 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:08.059709 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1b86639d-b663-44a5-8f8a-62f7fa9cae70 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:08.236530 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-1b86639d-b663-44a5-8f8a-62f7fa9cae70 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:08.246647 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-1b86639d-b663-44a5-8f8a-62f7fa9cae70 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:08.248348 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-1b86639d-b663-44a5-8f8a-62f7fa9cae70 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:08.249566 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-1b86639d-b663-44a5-8f8a-62f7fa9cae70 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1730 microversion: 2.20 time: 0.217895 Jun 17 11:48:08.250385 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 439/871] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:48:08 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1730 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:48:08.458753 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4c593b73-439c-44e7-bea8-a1ae6f21982b tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:08.459539 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4c593b73-439c-44e7-bea8-a1ae6f21982b tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:08.466365 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4c593b73-439c-44e7-bea8-a1ae6f21982b tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:08.466896 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4c593b73-439c-44e7-bea8-a1ae6f21982b tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:08.467733 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4c593b73-439c-44e7-bea8-a1ae6f21982b tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:08.468171 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4c593b73-439c-44e7-bea8-a1ae6f21982b tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:08.483170 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-33ce160b-eb6c-49cb-a8cc-c3fa9953d306 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:08.483713 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-33ce160b-eb6c-49cb-a8cc-c3fa9953d306 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:08.492094 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-33ce160b-eb6c-49cb-a8cc-c3fa9953d306 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:08.492543 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-33ce160b-eb6c-49cb-a8cc-c3fa9953d306 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:08.493351 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-33ce160b-eb6c-49cb-a8cc-c3fa9953d306 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:08.493794 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-33ce160b-eb6c-49cb-a8cc-c3fa9953d306 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:08.526412 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-33ce160b-eb6c-49cb-a8cc-c3fa9953d306 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Going to try to terminate instance {{(pid=124845) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 11:48:08.546016 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4c593b73-439c-44e7-bea8-a1ae6f21982b tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:08.546016 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4c593b73-439c-44e7-bea8-a1ae6f21982b tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:08.546016 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-4c593b73-439c-44e7-bea8-a1ae6f21982b tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lazy-loading 'fault' on Instance uuid 2ed47de2-4bfc-4635-8345-47b1cc369892 {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:48:08.609411 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4c593b73-439c-44e7-bea8-a1ae6f21982b tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78027ac3a2c463fbe14da8443a09761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e2c02ed78431fbbc93d3da1a7caba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:08.623841 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4c593b73-439c-44e7-bea8-a1ae6f21982b tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892" status: 200 len: 1327 microversion: 2.1 time: 0.168986 Jun 17 11:48:08.624740 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 433/872] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:08 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 => generated 1327 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:48:08.937204 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-33ce160b-eb6c-49cb-a8cc-c3fa9953d306 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 204 len: 0 microversion: 2.1 time: 0.467327 Jun 17 11:48:08.937816 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 440/873] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 17 11:48:08 2022] DELETE /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 11:48:08.946705 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-9fecd7c5-db68-439e-8097-8cdc697b5582 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:08.947331 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-9fecd7c5-db68-439e-8097-8cdc697b5582 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:08.955110 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9fecd7c5-db68-439e-8097-8cdc697b5582 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:08.956379 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9fecd7c5-db68-439e-8097-8cdc697b5582 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:08.957344 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9fecd7c5-db68-439e-8097-8cdc697b5582 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:08.957795 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9fecd7c5-db68-439e-8097-8cdc697b5582 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:09.103027 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-9fecd7c5-db68-439e-8097-8cdc697b5582 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:09.111120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-9fecd7c5-db68-439e-8097-8cdc697b5582 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1552 microversion: 2.1 time: 0.168177 Jun 17 11:48:09.111761 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 434/874] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:08 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1552 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:48:09.272544 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a5ad38ae-3e12-43a8-8ee7-d0867852e27f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:09.273965 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a5ad38ae-3e12-43a8-8ee7-d0867852e27f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:09.282774 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a5ad38ae-3e12-43a8-8ee7-d0867852e27f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:09.283229 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a5ad38ae-3e12-43a8-8ee7-d0867852e27f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:09.284862 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a5ad38ae-3e12-43a8-8ee7-d0867852e27f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:09.285425 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a5ad38ae-3e12-43a8-8ee7-d0867852e27f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:09.436692 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a5ad38ae-3e12-43a8-8ee7-d0867852e27f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:09.445319 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a5ad38ae-3e12-43a8-8ee7-d0867852e27f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:09.446851 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a5ad38ae-3e12-43a8-8ee7-d0867852e27f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:09.448242 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a5ad38ae-3e12-43a8-8ee7-d0867852e27f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1730 microversion: 2.20 time: 0.182285 Jun 17 11:48:09.448702 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 441/875] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:48:09 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:48:09.641475 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-eea8e75d-a500-406e-be32-e3b1bc2c459f tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:09.642133 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-eea8e75d-a500-406e-be32-e3b1bc2c459f tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:09.649810 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-eea8e75d-a500-406e-be32-e3b1bc2c459f tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:09.650266 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-eea8e75d-a500-406e-be32-e3b1bc2c459f tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:09.651061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-eea8e75d-a500-406e-be32-e3b1bc2c459f tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:09.651564 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-eea8e75d-a500-406e-be32-e3b1bc2c459f tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:09.667792 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-eea8e75d-a500-406e-be32-e3b1bc2c459f tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] HTTP exception thrown: Instance 2ed47de2-4bfc-4635-8345-47b1cc369892 could not be found. Jun 17 11:48:09.669535 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-eea8e75d-a500-406e-be32-e3b1bc2c459f tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Request method failure captured: Jun 17 11:48:09.669535 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: request: GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 HTTP/1.1 Jun 17 11:48:09.669535 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept: application/json Jun 17 11:48:09.669535 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jun 17 11:48:09.669535 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Connection: close Jun 17 11:48:09.669535 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jun 17 11:48:09.669535 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jun 17 11:48:09.669535 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Host: 10.222.0.45 Jun 17 11:48:09.669535 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jun 17 11:48:09.669535 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jun 17 11:48:09.669535 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABirGhQQ3IJvv2fai7On2SBVJl_m9m3AYw-cTGmCzOCcME6LK5cL8D62JHLQnt2J3JIvrIZ98xWBbJa3BnXTQQwPhM9HIAnuJPtaYHwR6Zw9rsrisXV3AituD6-4T-j-g0n_VQsenJYLpsnbGsNw3t4zRf1_cCdpskb_SoViAyw28PLi78 Jun 17 11:48:09.669535 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jun 17 11:48:09.669535 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jun 17 11:48:09.669535 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jun 17 11:48:09.669535 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jun 17 11:48:09.669535 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jun 17 11:48:09.669535 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jun 17 11:48:09.669535 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Id: b35e2c02ed78431fbbc93d3da1a7caba Jun 17 11:48:09.669535 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-AttachVolumeTestJSON-1843768207 Jun 17 11:48:09.669535 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Role: member,reader Jun 17 11:48:09.669535 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Roles: member,reader Jun 17 11:48:09.671104 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b35e2c02ed78431fbbc93d3da1a7caba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b35e2c02ed78431fbbc93d3da1a7caba", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b35e2c02ed78431fbbc93d3da1a7caba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b35e2c02ed78431fbbc93d3da1a7caba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:48:09.671104 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-AttachVolumeTestJSON-1843768207 Jun 17 11:48:09.671104 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Id: b35e2c02ed78431fbbc93d3da1a7caba Jun 17 11:48:09.671104 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1843768207 Jun 17 11:48:09.671104 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User: tempest-AttachVolumeTestJSON-1843768207-project Jun 17 11:48:09.671104 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jun 17 11:48:09.671104 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jun 17 11:48:09.671104 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Id: f78027ac3a2c463fbe14da8443a09761 Jun 17 11:48:09.671104 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-AttachVolumeTestJSON-1843768207-project Jun 17 11:48:09.671104 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: method: > Jun 17 11:48:09.671104 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: exception: Instance 2ed47de2-4bfc-4635-8345-47b1cc369892 could not be found. Jun 17 11:48:09.671104 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: action_args: {'id': '2ed47de2-4bfc-4635-8345-47b1cc369892'} Jun 17 11:48:09.672069 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:48:09.672069 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:09.672069 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:48:09.672069 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:48:09.672069 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:48:09.672069 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:48:09.672069 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:48:09.672069 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:48:09.672069 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:48:09.672069 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:48:09.672069 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ed47de2-4bfc-4635-8345-47b1cc369892 could not be found. Jun 17 11:48:09.672069 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:09.672069 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:09.672069 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:09.672069 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:09.672069 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:09.672069 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:09.672069 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:48:09.672069 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:48:09.672069 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:48:09.673752 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:48:09.673752 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 11:48:09.673752 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 11:48:09.673752 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:48:09.673752 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:48:09.673752 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:48:09.673752 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:48:09.673752 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ed47de2-4bfc-4635-8345-47b1cc369892 could not be found. Jun 17 11:48:09.673752 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:09.673752 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:09.673752 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:09.673752 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:09.673752 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:09.673752 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:09.673752 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:48:09.673752 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:48:09.673752 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ed47de2-4bfc-4635-8345-47b1cc369892 could not be found. Jun 17 11:48:09.673752 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:09.675732 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-eea8e75d-a500-406e-be32-e3b1bc2c459f tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Returning 404 to user: Instance 2ed47de2-4bfc-4635-8345-47b1cc369892 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:48:09.675732 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-eea8e75d-a500-406e-be32-e3b1bc2c459f tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892" status: 404 len: 111 microversion: 2.1 time: 0.033500 Jun 17 11:48:09.675732 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 435/876] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:09 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:48:09.680492 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c93f1bb9-c282-4986-b0ae-5cbbd7aa4a89 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '.version_select at 0x7f9c7695baf0>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:09.793725 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c93f1bb9-c282-4986-b0ae-5cbbd7aa4a89 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-972361664" status: 202 len: 0 microversion: 2.1 time: 0.117048 Jun 17 11:48:09.794385 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 442/877] 10.222.0.45 () {58 vars in 1217 bytes} [Fri Jun 17 11:48:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-972361664 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 11:48:10.130122 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-bb8664b2-935d-4782-8f05-dbaae49b2752 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:10.130744 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-bb8664b2-935d-4782-8f05-dbaae49b2752 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:10.137022 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bb8664b2-935d-4782-8f05-dbaae49b2752 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:10.137409 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bb8664b2-935d-4782-8f05-dbaae49b2752 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:10.138197 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bb8664b2-935d-4782-8f05-dbaae49b2752 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:10.138639 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bb8664b2-935d-4782-8f05-dbaae49b2752 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:10.274413 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-bb8664b2-935d-4782-8f05-dbaae49b2752 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:10.282138 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-bb8664b2-935d-4782-8f05-dbaae49b2752 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1552 microversion: 2.1 time: 0.156912 Jun 17 11:48:10.282790 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 436/878] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:10 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1552 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:48:10.467677 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4ab8787e-6109-45b6-a3c9-f36e17676dfa tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:10.468522 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4ab8787e-6109-45b6-a3c9-f36e17676dfa tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:10.477295 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4ab8787e-6109-45b6-a3c9-f36e17676dfa tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:10.477746 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4ab8787e-6109-45b6-a3c9-f36e17676dfa tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:10.478535 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4ab8787e-6109-45b6-a3c9-f36e17676dfa tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:10.478972 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4ab8787e-6109-45b6-a3c9-f36e17676dfa tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:10.653675 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-4ab8787e-6109-45b6-a3c9-f36e17676dfa tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:10.663951 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-4ab8787e-6109-45b6-a3c9-f36e17676dfa tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:10.668368 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-4ab8787e-6109-45b6-a3c9-f36e17676dfa tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:10.668368 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4ab8787e-6109-45b6-a3c9-f36e17676dfa tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1730 microversion: 2.20 time: 0.203683 Jun 17 11:48:10.668368 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 443/879] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:48:10 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1730 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:48:11.300352 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8e61c330-bf83-46b9-9bd1-c6e814969e7b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:11.300919 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-8e61c330-bf83-46b9-9bd1-c6e814969e7b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:11.308419 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8e61c330-bf83-46b9-9bd1-c6e814969e7b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:11.309003 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8e61c330-bf83-46b9-9bd1-c6e814969e7b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:11.310015 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8e61c330-bf83-46b9-9bd1-c6e814969e7b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:11.310496 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8e61c330-bf83-46b9-9bd1-c6e814969e7b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:11.396551 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-8e61c330-bf83-46b9-9bd1-c6e814969e7b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:11.405369 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-8e61c330-bf83-46b9-9bd1-c6e814969e7b tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1510 microversion: 2.1 time: 0.109274 Jun 17 11:48:11.405931 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-e31c604a-504a-4e7a-9b6b-71276378a014 req-a5707c48-0aa3-46e4-966a-1d4e397096ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907", "name": "network-vif-deleted", "tag": "f866082a-76d6-466b-8c49-7a5068d4d87f"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:48:11.406093 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 437/880] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:11 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1510 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:48:11.421829 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-e31c604a-504a-4e7a-9b6b-71276378a014 req-a5707c48-0aa3-46e4-966a-1d4e397096ed service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:11.422268 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-e31c604a-504a-4e7a-9b6b-71276378a014 req-a5707c48-0aa3-46e4-966a-1d4e397096ed service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:11.444113 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-e31c604a-504a-4e7a-9b6b-71276378a014 req-a5707c48-0aa3-46e4-966a-1d4e397096ed service nova] Creating event network-vif-deleted:f866082a-76d6-466b-8c49-7a5068d4d87f for instance 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 on hv-cinder-83716 Jun 17 11:48:11.451600 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-e31c604a-504a-4e7a-9b6b-71276378a014 req-a5707c48-0aa3-46e4-966a-1d4e397096ed service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049187 Jun 17 11:48:11.457499 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 444/881] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:48:11.685878 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a47cea1c-6306-446b-bde8-d7fb4f420ba7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:11.686440 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a47cea1c-6306-446b-bde8-d7fb4f420ba7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:11.693725 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a47cea1c-6306-446b-bde8-d7fb4f420ba7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:11.694183 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a47cea1c-6306-446b-bde8-d7fb4f420ba7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:11.694962 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a47cea1c-6306-446b-bde8-d7fb4f420ba7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:11.695428 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a47cea1c-6306-446b-bde8-d7fb4f420ba7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:11.840481 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a47cea1c-6306-446b-bde8-d7fb4f420ba7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:11.849802 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a47cea1c-6306-446b-bde8-d7fb4f420ba7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:11.851347 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a47cea1c-6306-446b-bde8-d7fb4f420ba7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:11.852542 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a47cea1c-6306-446b-bde8-d7fb4f420ba7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1717 microversion: 2.20 time: 0.170663 Jun 17 11:48:11.853102 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 438/882] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:48:11 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1717 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:48:12.427514 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b5dc8cc0-0af7-4580-b820-cb5aa066f0fe tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:12.428216 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b5dc8cc0-0af7-4580-b820-cb5aa066f0fe tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:12.440268 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b5dc8cc0-0af7-4580-b820-cb5aa066f0fe tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:12.440268 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b5dc8cc0-0af7-4580-b820-cb5aa066f0fe tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:12.440268 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b5dc8cc0-0af7-4580-b820-cb5aa066f0fe tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:12.440268 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b5dc8cc0-0af7-4580-b820-cb5aa066f0fe tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:12.469109 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b5dc8cc0-0af7-4580-b820-cb5aa066f0fe tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:12.469556 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b5dc8cc0-0af7-4580-b820-cb5aa066f0fe tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:12.470008 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-b5dc8cc0-0af7-4580-b820-cb5aa066f0fe tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lazy-loading 'fault' on Instance uuid 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:48:12.514394 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b5dc8cc0-0af7-4580-b820-cb5aa066f0fe tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac50aafcdf92434ba0ef7c8f42642ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6466d6627209487ca62377eb7aa5d9e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:12.523090 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b5dc8cc0-0af7-4580-b820-cb5aa066f0fe tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 200 len: 1347 microversion: 2.1 time: 0.100684 Jun 17 11:48:12.523713 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 445/883] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:12 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 1347 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:48:13.283878 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b9aff1fe-4002-489b-90fc-1bf5a1ae2058 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:13.284392 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b9aff1fe-4002-489b-90fc-1bf5a1ae2058 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:13.291820 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b9aff1fe-4002-489b-90fc-1bf5a1ae2058 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:13.292269 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b9aff1fe-4002-489b-90fc-1bf5a1ae2058 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:13.293042 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b9aff1fe-4002-489b-90fc-1bf5a1ae2058 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:13.293487 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b9aff1fe-4002-489b-90fc-1bf5a1ae2058 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:13.307229 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-b9aff1fe-4002-489b-90fc-1bf5a1ae2058 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] HTTP exception thrown: Instance 2ed47de2-4bfc-4635-8345-47b1cc369892 could not be found. Jun 17 11:48:13.308808 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b9aff1fe-4002-489b-90fc-1bf5a1ae2058 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Request method failure captured: Jun 17 11:48:13.308808 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: request: DELETE /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 HTTP/1.1 Jun 17 11:48:13.308808 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept: application/json Jun 17 11:48:13.308808 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jun 17 11:48:13.308808 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Connection: close Jun 17 11:48:13.308808 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jun 17 11:48:13.308808 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jun 17 11:48:13.308808 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Host: 10.222.0.45 Jun 17 11:48:13.308808 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jun 17 11:48:13.308808 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jun 17 11:48:13.308808 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABirGhQQ3IJvv2fai7On2SBVJl_m9m3AYw-cTGmCzOCcME6LK5cL8D62JHLQnt2J3JIvrIZ98xWBbJa3BnXTQQwPhM9HIAnuJPtaYHwR6Zw9rsrisXV3AituD6-4T-j-g0n_VQsenJYLpsnbGsNw3t4zRf1_cCdpskb_SoViAyw28PLi78 Jun 17 11:48:13.308808 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jun 17 11:48:13.308808 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jun 17 11:48:13.308808 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jun 17 11:48:13.308808 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jun 17 11:48:13.308808 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jun 17 11:48:13.308808 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jun 17 11:48:13.308808 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Id: b35e2c02ed78431fbbc93d3da1a7caba Jun 17 11:48:13.308808 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-AttachVolumeTestJSON-1843768207 Jun 17 11:48:13.308808 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Role: member,reader Jun 17 11:48:13.308808 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Roles: member,reader Jun 17 11:48:13.310400 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b35e2c02ed78431fbbc93d3da1a7caba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b35e2c02ed78431fbbc93d3da1a7caba", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b35e2c02ed78431fbbc93d3da1a7caba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b35e2c02ed78431fbbc93d3da1a7caba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:48:13.310400 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-AttachVolumeTestJSON-1843768207 Jun 17 11:48:13.310400 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Id: b35e2c02ed78431fbbc93d3da1a7caba Jun 17 11:48:13.310400 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1843768207 Jun 17 11:48:13.310400 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User: tempest-AttachVolumeTestJSON-1843768207-project Jun 17 11:48:13.310400 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jun 17 11:48:13.310400 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jun 17 11:48:13.310400 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Id: f78027ac3a2c463fbe14da8443a09761 Jun 17 11:48:13.310400 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-AttachVolumeTestJSON-1843768207-project Jun 17 11:48:13.310400 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: method: > Jun 17 11:48:13.310400 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: exception: Instance 2ed47de2-4bfc-4635-8345-47b1cc369892 could not be found. Jun 17 11:48:13.310400 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: action_args: {'id': '2ed47de2-4bfc-4635-8345-47b1cc369892'} Jun 17 11:48:13.312148 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:48:13.312148 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:13.312148 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:48:13.312148 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:48:13.312148 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:48:13.312148 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:48:13.312148 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:48:13.312148 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:48:13.312148 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:48:13.312148 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:48:13.312148 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ed47de2-4bfc-4635-8345-47b1cc369892 could not be found. Jun 17 11:48:13.312148 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:13.312148 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:13.312148 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:13.312148 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:13.312148 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:13.312148 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:13.312148 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:48:13.312148 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:48:13.312148 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:48:13.313589 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:48:13.313589 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 11:48:13.313589 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 11:48:13.313589 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 11:48:13.313589 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 11:48:13.313589 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:48:13.313589 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:48:13.313589 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:48:13.313589 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:48:13.313589 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ed47de2-4bfc-4635-8345-47b1cc369892 could not be found. Jun 17 11:48:13.313589 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:13.313589 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:13.313589 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:13.313589 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:13.313589 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:13.313589 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:13.313589 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:48:13.313589 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:48:13.313589 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ed47de2-4bfc-4635-8345-47b1cc369892 could not be found. Jun 17 11:48:13.313589 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:13.315011 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b9aff1fe-4002-489b-90fc-1bf5a1ae2058 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Returning 404 to user: Instance 2ed47de2-4bfc-4635-8345-47b1cc369892 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:48:13.315011 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b9aff1fe-4002-489b-90fc-1bf5a1ae2058 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892" status: 404 len: 111 microversion: 2.1 time: 0.030240 Jun 17 11:48:13.315011 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 439/884] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 17 11:48:13 2022] DELETE /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:48:13.318943 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-14f8f8ec-a31b-4f2f-853e-98fad3b2c297 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:13.319626 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-14f8f8ec-a31b-4f2f-853e-98fad3b2c297 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: 2ed47de2-4bfc-4635-8345-47b1cc369892] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:13.325712 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-14f8f8ec-a31b-4f2f-853e-98fad3b2c297 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:13.326157 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-14f8f8ec-a31b-4f2f-853e-98fad3b2c297 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:13.326919 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-14f8f8ec-a31b-4f2f-853e-98fad3b2c297 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:13.327355 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-14f8f8ec-a31b-4f2f-853e-98fad3b2c297 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:13.341165 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-14f8f8ec-a31b-4f2f-853e-98fad3b2c297 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] HTTP exception thrown: Instance 2ed47de2-4bfc-4635-8345-47b1cc369892 could not be found. Jun 17 11:48:13.342835 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-14f8f8ec-a31b-4f2f-853e-98fad3b2c297 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Request method failure captured: Jun 17 11:48:13.342835 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 HTTP/1.1 Jun 17 11:48:13.342835 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jun 17 11:48:13.342835 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jun 17 11:48:13.342835 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Connection: close Jun 17 11:48:13.342835 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jun 17 11:48:13.342835 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jun 17 11:48:13.342835 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.45 Jun 17 11:48:13.342835 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jun 17 11:48:13.342835 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jun 17 11:48:13.342835 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABirGhQQ3IJvv2fai7On2SBVJl_m9m3AYw-cTGmCzOCcME6LK5cL8D62JHLQnt2J3JIvrIZ98xWBbJa3BnXTQQwPhM9HIAnuJPtaYHwR6Zw9rsrisXV3AituD6-4T-j-g0n_VQsenJYLpsnbGsNw3t4zRf1_cCdpskb_SoViAyw28PLi78 Jun 17 11:48:13.342835 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jun 17 11:48:13.342835 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jun 17 11:48:13.342835 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jun 17 11:48:13.342835 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jun 17 11:48:13.342835 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jun 17 11:48:13.342835 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jun 17 11:48:13.342835 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Id: b35e2c02ed78431fbbc93d3da1a7caba Jun 17 11:48:13.342835 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-AttachVolumeTestJSON-1843768207 Jun 17 11:48:13.342835 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jun 17 11:48:13.342835 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jun 17 11:48:13.344421 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b35e2c02ed78431fbbc93d3da1a7caba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b35e2c02ed78431fbbc93d3da1a7caba", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b35e2c02ed78431fbbc93d3da1a7caba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b35e2c02ed78431fbbc93d3da1a7caba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:48:13.344421 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-AttachVolumeTestJSON-1843768207 Jun 17 11:48:13.344421 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: b35e2c02ed78431fbbc93d3da1a7caba Jun 17 11:48:13.344421 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1843768207 Jun 17 11:48:13.344421 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User: tempest-AttachVolumeTestJSON-1843768207-project Jun 17 11:48:13.344421 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jun 17 11:48:13.344421 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jun 17 11:48:13.344421 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Id: f78027ac3a2c463fbe14da8443a09761 Jun 17 11:48:13.344421 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-AttachVolumeTestJSON-1843768207-project Jun 17 11:48:13.344421 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: method: > Jun 17 11:48:13.344421 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: exception: Instance 2ed47de2-4bfc-4635-8345-47b1cc369892 could not be found. Jun 17 11:48:13.344421 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: action_args: {'id': '2ed47de2-4bfc-4635-8345-47b1cc369892'} Jun 17 11:48:13.345332 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:48:13.345332 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:13.345332 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:48:13.345332 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:48:13.345332 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:48:13.345332 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:48:13.345332 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:48:13.345332 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:48:13.345332 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:48:13.345332 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:48:13.345332 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ed47de2-4bfc-4635-8345-47b1cc369892 could not be found. Jun 17 11:48:13.345332 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:13.345332 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:13.345332 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:13.345332 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:13.345332 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:13.345332 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:13.345332 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:48:13.345332 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:48:13.345332 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:48:13.346518 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:48:13.346518 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 11:48:13.346518 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 11:48:13.346518 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:48:13.346518 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:48:13.346518 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:48:13.346518 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:48:13.346518 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ed47de2-4bfc-4635-8345-47b1cc369892 could not be found. Jun 17 11:48:13.346518 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:13.346518 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:13.346518 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:13.346518 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:13.346518 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:13.346518 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:13.346518 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:48:13.346518 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:48:13.346518 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ed47de2-4bfc-4635-8345-47b1cc369892 could not be found. Jun 17 11:48:13.346518 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:13.348537 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-14f8f8ec-a31b-4f2f-853e-98fad3b2c297 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Returning 404 to user: Instance 2ed47de2-4bfc-4635-8345-47b1cc369892 could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:48:13.348537 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-14f8f8ec-a31b-4f2f-853e-98fad3b2c297 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892" status: 404 len: 111 microversion: 2.1 time: 0.029285 Jun 17 11:48:13.348537 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 446/885] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:13 2022] GET /compute/v2.1/servers/2ed47de2-4bfc-4635-8345-47b1cc369892 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:48:13.541355 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1f57c605-5f99-4dc2-a4cc-78c1c1b8e407 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:13.541891 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-1f57c605-5f99-4dc2-a4cc-78c1c1b8e407 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] [instance: 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:13.548257 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1f57c605-5f99-4dc2-a4cc-78c1c1b8e407 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:13.548707 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1f57c605-5f99-4dc2-a4cc-78c1c1b8e407 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:13.549493 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1f57c605-5f99-4dc2-a4cc-78c1c1b8e407 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:13.549963 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1f57c605-5f99-4dc2-a4cc-78c1c1b8e407 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:13.565124 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-1f57c605-5f99-4dc2-a4cc-78c1c1b8e407 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] HTTP exception thrown: Instance 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 could not be found. Jun 17 11:48:13.567350 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1f57c605-5f99-4dc2-a4cc-78c1c1b8e407 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Request method failure captured: Jun 17 11:48:13.567350 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: request: GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 HTTP/1.1 Jun 17 11:48:13.567350 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept: application/json Jun 17 11:48:13.567350 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jun 17 11:48:13.567350 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Connection: close Jun 17 11:48:13.567350 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jun 17 11:48:13.567350 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jun 17 11:48:13.567350 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Host: 10.222.0.45 Jun 17 11:48:13.567350 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jun 17 11:48:13.567350 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jun 17 11:48:13.567350 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABirGk2RfYmzw7qegPKIjQ7eUg6cjWeZ2xAgSpomfHJ9ABXAY5mOyNS8QXhJARYcrUNKtSNQ9GmJFo_YnZMVKPjavRCO22eESQ3P0C-zs_K0sgXmBwBM1R9j0s7S6XYNyAMxuos2-QWgYxSrjktMWqC9upSIkgE2j1lnjokuYX3PbVPz2s Jun 17 11:48:13.567350 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jun 17 11:48:13.567350 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jun 17 11:48:13.567350 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jun 17 11:48:13.567350 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jun 17 11:48:13.567350 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jun 17 11:48:13.567350 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jun 17 11:48:13.567350 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Id: 6466d6627209487ca62377eb7aa5d9e4 Jun 17 11:48:13.567350 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-TestMinimumBasicScenario-429386431 Jun 17 11:48:13.567350 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Role: member,reader Jun 17 11:48:13.567350 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Roles: member,reader Jun 17 11:48:13.568982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6466d6627209487ca62377eb7aa5d9e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6466d6627209487ca62377eb7aa5d9e4", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6466d6627209487ca62377eb7aa5d9e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6466d6627209487ca62377eb7aa5d9e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:48:13.568982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-TestMinimumBasicScenario-429386431 Jun 17 11:48:13.568982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Id: 6466d6627209487ca62377eb7aa5d9e4 Jun 17 11:48:13.568982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-TestMinimumBasicScenario-429386431 Jun 17 11:48:13.568982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User: tempest-TestMinimumBasicScenario-429386431-project Jun 17 11:48:13.568982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jun 17 11:48:13.568982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jun 17 11:48:13.568982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Id: ac50aafcdf92434ba0ef7c8f42642ebb Jun 17 11:48:13.568982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-TestMinimumBasicScenario-429386431-project Jun 17 11:48:13.568982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: method: > Jun 17 11:48:13.568982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: exception: Instance 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 could not be found. Jun 17 11:48:13.568982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: action_args: {'id': '0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907'} Jun 17 11:48:13.569876 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:48:13.569876 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:13.569876 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:48:13.569876 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:48:13.569876 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:48:13.569876 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:48:13.569876 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:48:13.569876 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:48:13.569876 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:48:13.569876 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:48:13.569876 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 could not be found. Jun 17 11:48:13.569876 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:13.569876 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:13.569876 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:13.569876 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:13.569876 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:13.569876 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:13.569876 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:48:13.569876 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:48:13.569876 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:48:13.571312 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:48:13.571312 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 11:48:13.571312 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 11:48:13.571312 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:48:13.571312 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:48:13.571312 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:48:13.571312 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:48:13.571312 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 could not be found. Jun 17 11:48:13.571312 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:13.571312 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:13.571312 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:13.571312 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:13.571312 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:13.571312 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:13.571312 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:48:13.571312 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:48:13.571312 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 could not be found. Jun 17 11:48:13.571312 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:13.572663 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1f57c605-5f99-4dc2-a4cc-78c1c1b8e407 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Returning 404 to user: Instance 0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:48:13.572663 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-1f57c605-5f99-4dc2-a4cc-78c1c1b8e407 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907" status: 404 len: 111 microversion: 2.1 time: 0.031720 Jun 17 11:48:13.572663 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 440/886] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:13 2022] GET /compute/v2.1/servers/0ad9d1dd-1f43-4bfd-bd3a-3f408a08b907 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:48:13.578841 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c4ef2cd9-0ac8-468d-96af-3032830e9545 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] Calling method '.version_select at 0x7f9c767d3430>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:13.686288 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c4ef2cd9-0ac8-468d-96af-3032830e9545 tempest-TestMinimumBasicScenario-429386431 tempest-TestMinimumBasicScenario-429386431-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-852378024" status: 202 len: 0 microversion: 2.1 time: 0.111254 Jun 17 11:48:13.690938 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 447/887] 10.222.0.45 () {58 vars in 1268 bytes} [Fri Jun 17 11:48:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-852378024 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 11:48:14.669933 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e3e68f04-dc8a-4cbf-b8c1-d97c13512452 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:14.670459 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e3e68f04-dc8a-4cbf-b8c1-d97c13512452 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:14.678238 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e3e68f04-dc8a-4cbf-b8c1-d97c13512452 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:14.678686 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e3e68f04-dc8a-4cbf-b8c1-d97c13512452 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:14.679481 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e3e68f04-dc8a-4cbf-b8c1-d97c13512452 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:14.679915 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e3e68f04-dc8a-4cbf-b8c1-d97c13512452 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:14.694245 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-e3e68f04-dc8a-4cbf-b8c1-d97c13512452 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] HTTP exception thrown: Instance b8cd69a4-437d-4db2-bd02-b485b06773e2 could not be found. Jun 17 11:48:14.695929 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e3e68f04-dc8a-4cbf-b8c1-d97c13512452 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Request method failure captured: Jun 17 11:48:14.695929 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: request: DELETE /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 HTTP/1.1 Jun 17 11:48:14.695929 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept: application/json Jun 17 11:48:14.695929 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jun 17 11:48:14.695929 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Connection: close Jun 17 11:48:14.695929 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jun 17 11:48:14.695929 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jun 17 11:48:14.695929 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Host: 10.222.0.45 Jun 17 11:48:14.695929 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jun 17 11:48:14.695929 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jun 17 11:48:14.695929 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABirGhQQ3IJvv2fai7On2SBVJl_m9m3AYw-cTGmCzOCcME6LK5cL8D62JHLQnt2J3JIvrIZ98xWBbJa3BnXTQQwPhM9HIAnuJPtaYHwR6Zw9rsrisXV3AituD6-4T-j-g0n_VQsenJYLpsnbGsNw3t4zRf1_cCdpskb_SoViAyw28PLi78 Jun 17 11:48:14.695929 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jun 17 11:48:14.695929 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jun 17 11:48:14.695929 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jun 17 11:48:14.695929 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jun 17 11:48:14.695929 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jun 17 11:48:14.695929 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jun 17 11:48:14.695929 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Id: b35e2c02ed78431fbbc93d3da1a7caba Jun 17 11:48:14.695929 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-AttachVolumeTestJSON-1843768207 Jun 17 11:48:14.695929 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Role: member,reader Jun 17 11:48:14.695929 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Roles: member,reader Jun 17 11:48:14.697418 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b35e2c02ed78431fbbc93d3da1a7caba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b35e2c02ed78431fbbc93d3da1a7caba", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b35e2c02ed78431fbbc93d3da1a7caba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b35e2c02ed78431fbbc93d3da1a7caba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:48:14.697418 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-AttachVolumeTestJSON-1843768207 Jun 17 11:48:14.697418 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Id: b35e2c02ed78431fbbc93d3da1a7caba Jun 17 11:48:14.697418 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1843768207 Jun 17 11:48:14.697418 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User: tempest-AttachVolumeTestJSON-1843768207-project Jun 17 11:48:14.697418 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jun 17 11:48:14.697418 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jun 17 11:48:14.697418 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Id: f78027ac3a2c463fbe14da8443a09761 Jun 17 11:48:14.697418 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-AttachVolumeTestJSON-1843768207-project Jun 17 11:48:14.697418 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: method: > Jun 17 11:48:14.697418 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: exception: Instance b8cd69a4-437d-4db2-bd02-b485b06773e2 could not be found. Jun 17 11:48:14.697418 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: action_args: {'id': 'b8cd69a4-437d-4db2-bd02-b485b06773e2'} Jun 17 11:48:14.698416 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:48:14.698416 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:14.698416 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:48:14.698416 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:48:14.698416 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:48:14.698416 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:48:14.698416 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:48:14.698416 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:48:14.698416 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:48:14.698416 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:48:14.698416 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8cd69a4-437d-4db2-bd02-b485b06773e2 could not be found. Jun 17 11:48:14.698416 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:14.698416 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:14.698416 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:14.698416 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:14.698416 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:14.698416 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:14.698416 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:48:14.698416 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:48:14.698416 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:48:14.699711 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:48:14.699711 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 11:48:14.699711 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 11:48:14.699711 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 11:48:14.699711 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 11:48:14.699711 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:48:14.699711 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:48:14.699711 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:48:14.699711 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:48:14.699711 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8cd69a4-437d-4db2-bd02-b485b06773e2 could not be found. Jun 17 11:48:14.699711 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:14.699711 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:14.699711 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:14.699711 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:14.699711 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:14.699711 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:14.699711 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:48:14.699711 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:48:14.699711 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8cd69a4-437d-4db2-bd02-b485b06773e2 could not be found. Jun 17 11:48:14.699711 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:14.700917 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e3e68f04-dc8a-4cbf-b8c1-d97c13512452 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Returning 404 to user: Instance b8cd69a4-437d-4db2-bd02-b485b06773e2 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:48:14.700917 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e3e68f04-dc8a-4cbf-b8c1-d97c13512452 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 404 len: 111 microversion: 2.1 time: 0.031215 Jun 17 11:48:14.700917 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 441/888] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 17 11:48:14 2022] DELETE /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:48:14.706580 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-1f946567-0938-46b7-838a-6c979c60c072 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:14.707189 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-1f946567-0938-46b7-838a-6c979c60c072 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] [instance: b8cd69a4-437d-4db2-bd02-b485b06773e2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:14.711871 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:48:14.714734 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1f946567-0938-46b7-838a-6c979c60c072 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:14.715179 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1f946567-0938-46b7-838a-6c979c60c072 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:14.716017 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1f946567-0938-46b7-838a-6c979c60c072 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:14.716509 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1f946567-0938-46b7-838a-6c979c60c072 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:14.730362 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-1f946567-0938-46b7-838a-6c979c60c072 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] HTTP exception thrown: Instance b8cd69a4-437d-4db2-bd02-b485b06773e2 could not be found. Jun 17 11:48:14.731927 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-1f946567-0938-46b7-838a-6c979c60c072 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Request method failure captured: Jun 17 11:48:14.731927 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 HTTP/1.1 Jun 17 11:48:14.731927 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jun 17 11:48:14.731927 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jun 17 11:48:14.731927 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Connection: close Jun 17 11:48:14.731927 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jun 17 11:48:14.731927 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jun 17 11:48:14.731927 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.45 Jun 17 11:48:14.731927 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jun 17 11:48:14.731927 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jun 17 11:48:14.731927 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABirGhQQ3IJvv2fai7On2SBVJl_m9m3AYw-cTGmCzOCcME6LK5cL8D62JHLQnt2J3JIvrIZ98xWBbJa3BnXTQQwPhM9HIAnuJPtaYHwR6Zw9rsrisXV3AituD6-4T-j-g0n_VQsenJYLpsnbGsNw3t4zRf1_cCdpskb_SoViAyw28PLi78 Jun 17 11:48:14.731927 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jun 17 11:48:14.731927 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jun 17 11:48:14.731927 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jun 17 11:48:14.731927 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jun 17 11:48:14.731927 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jun 17 11:48:14.731927 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jun 17 11:48:14.731927 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Id: b35e2c02ed78431fbbc93d3da1a7caba Jun 17 11:48:14.731927 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-AttachVolumeTestJSON-1843768207 Jun 17 11:48:14.731927 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jun 17 11:48:14.731927 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jun 17 11:48:14.733481 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b35e2c02ed78431fbbc93d3da1a7caba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b35e2c02ed78431fbbc93d3da1a7caba", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b35e2c02ed78431fbbc93d3da1a7caba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b35e2c02ed78431fbbc93d3da1a7caba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:48:14.733481 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-AttachVolumeTestJSON-1843768207 Jun 17 11:48:14.733481 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: b35e2c02ed78431fbbc93d3da1a7caba Jun 17 11:48:14.733481 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1843768207 Jun 17 11:48:14.733481 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User: tempest-AttachVolumeTestJSON-1843768207-project Jun 17 11:48:14.733481 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jun 17 11:48:14.733481 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jun 17 11:48:14.733481 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Id: f78027ac3a2c463fbe14da8443a09761 Jun 17 11:48:14.733481 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-AttachVolumeTestJSON-1843768207-project Jun 17 11:48:14.733481 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: method: > Jun 17 11:48:14.733481 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: exception: Instance b8cd69a4-437d-4db2-bd02-b485b06773e2 could not be found. Jun 17 11:48:14.733481 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: action_args: {'id': 'b8cd69a4-437d-4db2-bd02-b485b06773e2'} Jun 17 11:48:14.734345 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:48:14.734345 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:14.734345 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:48:14.734345 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:48:14.734345 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:48:14.734345 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:48:14.734345 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:48:14.734345 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:48:14.734345 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:48:14.734345 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:48:14.734345 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8cd69a4-437d-4db2-bd02-b485b06773e2 could not be found. Jun 17 11:48:14.734345 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:14.734345 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:14.734345 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:14.734345 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:14.734345 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:14.734345 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:14.734345 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:48:14.734345 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:48:14.734345 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:48:14.735578 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:48:14.735578 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 11:48:14.735578 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 11:48:14.735578 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:48:14.735578 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:48:14.735578 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:48:14.735578 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:48:14.735578 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8cd69a4-437d-4db2-bd02-b485b06773e2 could not be found. Jun 17 11:48:14.735578 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:14.735578 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:14.735578 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:14.735578 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:14.735578 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:14.735578 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:14.735578 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:48:14.735578 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:48:14.735578 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8cd69a4-437d-4db2-bd02-b485b06773e2 could not be found. Jun 17 11:48:14.735578 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:14.736666 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-1f946567-0938-46b7-838a-6c979c60c072 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] Returning 404 to user: Instance b8cd69a4-437d-4db2-bd02-b485b06773e2 could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:48:14.736666 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-1f946567-0938-46b7-838a-6c979c60c072 tempest-AttachVolumeTestJSON-1843768207 tempest-AttachVolumeTestJSON-1843768207-project] 10.222.0.45 "GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2" status: 404 len: 111 microversion: 2.1 time: 0.031079 Jun 17 11:48:14.736666 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 448/889] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:14 2022] GET /compute/v2.1/servers/b8cd69a4-437d-4db2-bd02-b485b06773e2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:48:17.698861 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-cf09fccf-70ee-4530-9024-7f551345deb9 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:17.699720 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-cf09fccf-70ee-4530-9024-7f551345deb9 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 52cfb97a-c546-496a-9557-1663ada483b3] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:17.711650 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cf09fccf-70ee-4530-9024-7f551345deb9 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:17.712115 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cf09fccf-70ee-4530-9024-7f551345deb9 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:17.712993 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cf09fccf-70ee-4530-9024-7f551345deb9 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:17.713380 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cf09fccf-70ee-4530-9024-7f551345deb9 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:17.744030 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-cf09fccf-70ee-4530-9024-7f551345deb9 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3/ips" status: 200 len: 149 microversion: 2.1 time: 0.053542 Jun 17 11:48:17.751095 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 442/890] 10.222.0.45 () {58 vars in 1247 bytes} [Fri Jun 17 11:48:17 2022] GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3/ips => generated 149 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:48:19.587007 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9c82d3f4-667c-4cba-9fda-198dfe899f9b tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f05cc58c-519f-4c8f-afad-8f48fa1cdbb3"}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:48:19.588136 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9c82d3f4-667c-4cba-9fda-198dfe899f9b tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 52cfb97a-c546-496a-9557-1663ada483b3] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:19.597762 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9c82d3f4-667c-4cba-9fda-198dfe899f9b tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:19.598901 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9c82d3f4-667c-4cba-9fda-198dfe899f9b tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:19.600148 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9c82d3f4-667c-4cba-9fda-198dfe899f9b tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:19.600759 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9c82d3f4-667c-4cba-9fda-198dfe899f9b tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:20.935894 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9c82d3f4-667c-4cba-9fda-198dfe899f9b tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "POST /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.353143 Jun 17 11:48:20.937910 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 449/891] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jun 17 11:48:19 2022] POST /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3/os-volume_attachments => generated 194 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:48:29.731837 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-98687fcf-366b-45c9-bed0-859a3a12812f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:29.732911 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-98687fcf-366b-45c9-bed0-859a3a12812f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 52cfb97a-c546-496a-9557-1663ada483b3] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:29.736391 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=75 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:48:29.737218 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=45 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:48:29.743981 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-98687fcf-366b-45c9-bed0-859a3a12812f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:29.744117 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-98687fcf-366b-45c9-bed0-859a3a12812f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:29.745089 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-98687fcf-366b-45c9-bed0-859a3a12812f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:29.745535 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-98687fcf-366b-45c9-bed0-859a3a12812f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:29.842378 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-98687fcf-366b-45c9-bed0-859a3a12812f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lazy-loading 'services' on Instance uuid 52cfb97a-c546-496a-9557-1663ada483b3 {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:48:30.089915 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-98687fcf-366b-45c9-bed0-859a3a12812f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "DELETE /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3/os-volume_attachments/f05cc58c-519f-4c8f-afad-8f48fa1cdbb3" status: 202 len: 0 microversion: 2.1 time: 0.362865 Jun 17 11:48:30.090769 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 443/892] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Jun 17 11:48:29 2022] DELETE /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3/os-volume_attachments/f05cc58c-519f-4c8f-afad-8f48fa1cdbb3 => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 11:48:30.101144 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ab2f52f9-bb6f-496a-8bb9-e0dc01b0f27a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:30.102254 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-ab2f52f9-bb6f-496a-8bb9-e0dc01b0f27a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 52cfb97a-c546-496a-9557-1663ada483b3] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:30.109022 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ab2f52f9-bb6f-496a-8bb9-e0dc01b0f27a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:30.109476 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ab2f52f9-bb6f-496a-8bb9-e0dc01b0f27a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:30.110278 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ab2f52f9-bb6f-496a-8bb9-e0dc01b0f27a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:30.110743 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ab2f52f9-bb6f-496a-8bb9-e0dc01b0f27a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:30.118164 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:48:30.143548 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-ab2f52f9-bb6f-496a-8bb9-e0dc01b0f27a tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048130 Jun 17 11:48:30.144130 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 450/893] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 17 11:48:30 2022] GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:48:31.166735 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-58b06378-ff30-46af-b0c9-aed0b3e213f9 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:31.167861 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-58b06378-ff30-46af-b0c9-aed0b3e213f9 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 52cfb97a-c546-496a-9557-1663ada483b3] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:31.174366 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-58b06378-ff30-46af-b0c9-aed0b3e213f9 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:31.174821 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-58b06378-ff30-46af-b0c9-aed0b3e213f9 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:31.175626 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-58b06378-ff30-46af-b0c9-aed0b3e213f9 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:31.176088 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-58b06378-ff30-46af-b0c9-aed0b3e213f9 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:31.210296 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-58b06378-ff30-46af-b0c9-aed0b3e213f9 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048288 Jun 17 11:48:31.211107 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 444/894] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 17 11:48:31 2022] GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:48:32.222178 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-bf3aaed3-fb6e-4b19-8885-35505cbdd412 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:32.223283 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-bf3aaed3-fb6e-4b19-8885-35505cbdd412 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 52cfb97a-c546-496a-9557-1663ada483b3] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:32.230746 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bf3aaed3-fb6e-4b19-8885-35505cbdd412 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:32.231192 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bf3aaed3-fb6e-4b19-8885-35505cbdd412 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:32.232006 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bf3aaed3-fb6e-4b19-8885-35505cbdd412 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:32.232493 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bf3aaed3-fb6e-4b19-8885-35505cbdd412 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:32.275300 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-bf3aaed3-fb6e-4b19-8885-35505cbdd412 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057858 Jun 17 11:48:32.276111 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 451/895] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 17 11:48:32 2022] GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 11:48:32.369769 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e202441a-28dc-4cb2-a517-6bdb183b46d4 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:32.370540 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e202441a-28dc-4cb2-a517-6bdb183b46d4 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 52cfb97a-c546-496a-9557-1663ada483b3] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:32.385543 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e202441a-28dc-4cb2-a517-6bdb183b46d4 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:32.386381 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e202441a-28dc-4cb2-a517-6bdb183b46d4 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:32.387515 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e202441a-28dc-4cb2-a517-6bdb183b46d4 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:32.388396 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e202441a-28dc-4cb2-a517-6bdb183b46d4 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:32.420943 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e202441a-28dc-4cb2-a517-6bdb183b46d4 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 52cfb97a-c546-496a-9557-1663ada483b3] Going to try to terminate instance {{(pid=124844) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 11:48:32.816535 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e202441a-28dc-4cb2-a517-6bdb183b46d4 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "DELETE /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3" status: 204 len: 0 microversion: 2.1 time: 0.453908 Jun 17 11:48:32.817826 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 445/896] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 17 11:48:32 2022] DELETE /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 11:48:32.826609 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f30befac-09bc-41c8-9a6e-feb25ce516ea tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:32.827251 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f30befac-09bc-41c8-9a6e-feb25ce516ea tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 52cfb97a-c546-496a-9557-1663ada483b3] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:32.836115 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f30befac-09bc-41c8-9a6e-feb25ce516ea tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:32.836693 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f30befac-09bc-41c8-9a6e-feb25ce516ea tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:32.837652 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f30befac-09bc-41c8-9a6e-feb25ce516ea tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:32.838209 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f30befac-09bc-41c8-9a6e-feb25ce516ea tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:32.999062 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f30befac-09bc-41c8-9a6e-feb25ce516ea tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:33.007446 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f30befac-09bc-41c8-9a6e-feb25ce516ea tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3" status: 200 len: 1682 microversion: 2.1 time: 0.185174 Jun 17 11:48:33.008021 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 452/897] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:32 2022] GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3 => generated 1682 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:48:34.028571 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2758928e-5e68-4261-81e2-7717822e94fe tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:34.029355 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-2758928e-5e68-4261-81e2-7717822e94fe tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 52cfb97a-c546-496a-9557-1663ada483b3] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:34.037848 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2758928e-5e68-4261-81e2-7717822e94fe tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:34.038391 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2758928e-5e68-4261-81e2-7717822e94fe tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:34.039224 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2758928e-5e68-4261-81e2-7717822e94fe tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:34.039693 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2758928e-5e68-4261-81e2-7717822e94fe tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:34.213817 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2758928e-5e68-4261-81e2-7717822e94fe tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:34.224361 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2758928e-5e68-4261-81e2-7717822e94fe tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3" status: 200 len: 1682 microversion: 2.1 time: 0.201404 Jun 17 11:48:34.225337 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 446/898] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:34 2022] GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3 => generated 1682 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:48:35.243068 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6e1ad50d-681a-4d49-919d-eb847bd5e369 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:35.243824 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-6e1ad50d-681a-4d49-919d-eb847bd5e369 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 52cfb97a-c546-496a-9557-1663ada483b3] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:35.251184 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6e1ad50d-681a-4d49-919d-eb847bd5e369 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:35.251670 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6e1ad50d-681a-4d49-919d-eb847bd5e369 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:35.252483 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6e1ad50d-681a-4d49-919d-eb847bd5e369 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:35.252926 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6e1ad50d-681a-4d49-919d-eb847bd5e369 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:35.432592 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6e1ad50d-681a-4d49-919d-eb847bd5e369 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:35.445720 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-6e1ad50d-681a-4d49-919d-eb847bd5e369 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3" status: 200 len: 1682 microversion: 2.1 time: 0.206716 Jun 17 11:48:35.446833 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 453/899] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:35 2022] GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3 => generated 1682 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:48:35.746052 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-41f717f8-a022-4176-962f-b36e7b5ad939 req-9e8e5ef0-472b-4e80-bc25-232b54e747a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52cfb97a-c546-496a-9557-1663ada483b3", "name": "network-vif-deleted", "tag": "ec529d14-50c4-4d90-8fe1-d7b22fa82064"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:48:35.757846 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-41f717f8-a022-4176-962f-b36e7b5ad939 req-9e8e5ef0-472b-4e80-bc25-232b54e747a6 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:35.758473 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-41f717f8-a022-4176-962f-b36e7b5ad939 req-9e8e5ef0-472b-4e80-bc25-232b54e747a6 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:35.783974 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-41f717f8-a022-4176-962f-b36e7b5ad939 req-9e8e5ef0-472b-4e80-bc25-232b54e747a6 service nova] Creating event network-vif-deleted:ec529d14-50c4-4d90-8fe1-d7b22fa82064 for instance 52cfb97a-c546-496a-9557-1663ada483b3 on hv-cinder-83716 Jun 17 11:48:35.794429 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-41f717f8-a022-4176-962f-b36e7b5ad939 req-9e8e5ef0-472b-4e80-bc25-232b54e747a6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055585 Jun 17 11:48:35.798560 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 447/900] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:48:36.476480 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2048f223-69aa-4f0c-ae55-727c8276324e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:36.477857 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2048f223-69aa-4f0c-ae55-727c8276324e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 52cfb97a-c546-496a-9557-1663ada483b3] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:36.487274 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2048f223-69aa-4f0c-ae55-727c8276324e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:36.487800 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2048f223-69aa-4f0c-ae55-727c8276324e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:36.488790 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2048f223-69aa-4f0c-ae55-727c8276324e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:36.493866 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2048f223-69aa-4f0c-ae55-727c8276324e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:36.548470 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2048f223-69aa-4f0c-ae55-727c8276324e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:36.548926 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2048f223-69aa-4f0c-ae55-727c8276324e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:36.549401 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-2048f223-69aa-4f0c-ae55-727c8276324e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lazy-loading 'fault' on Instance uuid 52cfb97a-c546-496a-9557-1663ada483b3 {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:48:36.602701 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2048f223-69aa-4f0c-ae55-727c8276324e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e58eacbbb9e41fdbbb13f5b39be782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58cf63264414f30a98161f6027daad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:36.612342 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2048f223-69aa-4f0c-ae55-727c8276324e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3" status: 200 len: 1332 microversion: 2.1 time: 0.142817 Jun 17 11:48:36.613012 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 454/901] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:36 2022] GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3 => generated 1332 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:48:37.635916 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2158aa79-a556-40a1-98f8-f9b4be8adc8f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:37.636625 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-2158aa79-a556-40a1-98f8-f9b4be8adc8f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 52cfb97a-c546-496a-9557-1663ada483b3] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:37.643392 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2158aa79-a556-40a1-98f8-f9b4be8adc8f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:37.643860 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2158aa79-a556-40a1-98f8-f9b4be8adc8f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:37.645323 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2158aa79-a556-40a1-98f8-f9b4be8adc8f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:37.645817 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2158aa79-a556-40a1-98f8-f9b4be8adc8f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:37.660784 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-2158aa79-a556-40a1-98f8-f9b4be8adc8f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] HTTP exception thrown: Instance 52cfb97a-c546-496a-9557-1663ada483b3 could not be found. Jun 17 11:48:37.662578 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2158aa79-a556-40a1-98f8-f9b4be8adc8f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Request method failure captured: Jun 17 11:48:37.662578 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: request: GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3 HTTP/1.1 Jun 17 11:48:37.662578 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept: application/json Jun 17 11:48:37.662578 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jun 17 11:48:37.662578 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Connection: close Jun 17 11:48:37.662578 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jun 17 11:48:37.662578 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jun 17 11:48:37.662578 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Host: 10.222.0.45 Jun 17 11:48:37.662578 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jun 17 11:48:37.662578 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jun 17 11:48:37.662578 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABirGhbQZN58Mc4zyhUveG-Q-SFsZYiqbX0gxyltnPVCjSfEYNyfXfhfVCx5KdbK5qhE4EnaiOrUEMOKAhCCD_-tiKGRwJFUZvlEPvpBXY3_SY-UVihK6NaeFSNbrNpsHezSsj02ro8zcS2-cKoHlRfS3nCqLWBYJ5x0JyaHmYJlkw7b68 Jun 17 11:48:37.662578 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jun 17 11:48:37.662578 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jun 17 11:48:37.662578 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jun 17 11:48:37.662578 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jun 17 11:48:37.662578 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jun 17 11:48:37.662578 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jun 17 11:48:37.662578 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Id: c58cf63264414f30a98161f6027daad0 Jun 17 11:48:37.662578 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:48:37.662578 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Role: member,reader Jun 17 11:48:37.662578 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Roles: member,reader Jun 17 11:48:37.664249 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c58cf63264414f30a98161f6027daad0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c58cf63264414f30a98161f6027daad0", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c58cf63264414f30a98161f6027daad0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c58cf63264414f30a98161f6027daad0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:48:37.664249 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:48:37.664249 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Id: c58cf63264414f30a98161f6027daad0 Jun 17 11:48:37.664249 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:48:37.664249 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User: tempest-AttachVolumeNegativeTest-1942846496-project Jun 17 11:48:37.664249 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jun 17 11:48:37.664249 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jun 17 11:48:37.664249 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Id: 2e58eacbbb9e41fdbbb13f5b39be782a Jun 17 11:48:37.664249 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-AttachVolumeNegativeTest-1942846496-project Jun 17 11:48:37.664249 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: method: > Jun 17 11:48:37.664249 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: exception: Instance 52cfb97a-c546-496a-9557-1663ada483b3 could not be found. Jun 17 11:48:37.664249 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: action_args: {'id': '52cfb97a-c546-496a-9557-1663ada483b3'} Jun 17 11:48:37.668192 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:48:37.668192 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:37.668192 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:48:37.668192 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:48:37.668192 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:48:37.668192 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:48:37.668192 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:48:37.668192 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:48:37.668192 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:48:37.668192 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:48:37.668192 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52cfb97a-c546-496a-9557-1663ada483b3 could not be found. Jun 17 11:48:37.668192 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:37.668192 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:37.668192 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:37.668192 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:37.668192 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:37.668192 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:37.668192 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:48:37.668192 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:48:37.668192 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:48:37.670420 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:48:37.670420 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 11:48:37.670420 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 11:48:37.670420 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:48:37.670420 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:48:37.670420 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:48:37.670420 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:48:37.670420 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52cfb97a-c546-496a-9557-1663ada483b3 could not be found. Jun 17 11:48:37.670420 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:37.670420 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:37.670420 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:37.670420 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:37.670420 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:37.670420 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:37.670420 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:48:37.670420 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:48:37.670420 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52cfb97a-c546-496a-9557-1663ada483b3 could not be found. Jun 17 11:48:37.670420 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:37.672640 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2158aa79-a556-40a1-98f8-f9b4be8adc8f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Returning 404 to user: Instance 52cfb97a-c546-496a-9557-1663ada483b3 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:48:37.672640 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2158aa79-a556-40a1-98f8-f9b4be8adc8f tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3" status: 404 len: 111 microversion: 2.1 time: 0.032963 Jun 17 11:48:37.672640 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 448/902] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:37 2022] GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 11:48:37.674802 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-941ecf98-8d7e-4d88-9501-e515ac568894 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '.version_select at 0x7f9c7695b0d0>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:37.793157 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-941ecf98-8d7e-4d88-9501-e515ac568894 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1047941471" status: 202 len: 0 microversion: 2.1 time: 0.123478 Jun 17 11:48:37.793762 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 455/903] 10.222.0.45 () {58 vars in 1220 bytes} [Fri Jun 17 11:48:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1047941471 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 11:48:43.141558 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1edb4648-3492-49ec-bac9-5be6a6fcfbd8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:43.142139 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-1edb4648-3492-49ec-bac9-5be6a6fcfbd8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 52cfb97a-c546-496a-9557-1663ada483b3] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:43.149106 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1edb4648-3492-49ec-bac9-5be6a6fcfbd8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:43.149556 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1edb4648-3492-49ec-bac9-5be6a6fcfbd8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:43.150356 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1edb4648-3492-49ec-bac9-5be6a6fcfbd8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:43.150796 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1edb4648-3492-49ec-bac9-5be6a6fcfbd8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:43.166018 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-1edb4648-3492-49ec-bac9-5be6a6fcfbd8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] HTTP exception thrown: Instance 52cfb97a-c546-496a-9557-1663ada483b3 could not be found. Jun 17 11:48:43.167537 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1edb4648-3492-49ec-bac9-5be6a6fcfbd8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Request method failure captured: Jun 17 11:48:43.167537 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: request: DELETE /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3 HTTP/1.1 Jun 17 11:48:43.167537 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept: application/json Jun 17 11:48:43.167537 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jun 17 11:48:43.167537 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Connection: close Jun 17 11:48:43.167537 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jun 17 11:48:43.167537 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jun 17 11:48:43.167537 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Host: 10.222.0.45 Jun 17 11:48:43.167537 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jun 17 11:48:43.167537 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jun 17 11:48:43.167537 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABirGhbQZN58Mc4zyhUveG-Q-SFsZYiqbX0gxyltnPVCjSfEYNyfXfhfVCx5KdbK5qhE4EnaiOrUEMOKAhCCD_-tiKGRwJFUZvlEPvpBXY3_SY-UVihK6NaeFSNbrNpsHezSsj02ro8zcS2-cKoHlRfS3nCqLWBYJ5x0JyaHmYJlkw7b68 Jun 17 11:48:43.167537 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jun 17 11:48:43.167537 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jun 17 11:48:43.167537 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jun 17 11:48:43.167537 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jun 17 11:48:43.167537 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jun 17 11:48:43.167537 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jun 17 11:48:43.167537 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Id: c58cf63264414f30a98161f6027daad0 Jun 17 11:48:43.167537 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:48:43.167537 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Role: member,reader Jun 17 11:48:43.167537 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Roles: member,reader Jun 17 11:48:43.168913 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c58cf63264414f30a98161f6027daad0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c58cf63264414f30a98161f6027daad0", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c58cf63264414f30a98161f6027daad0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c58cf63264414f30a98161f6027daad0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:48:43.168913 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:48:43.168913 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Id: c58cf63264414f30a98161f6027daad0 Jun 17 11:48:43.168913 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:48:43.168913 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User: tempest-AttachVolumeNegativeTest-1942846496-project Jun 17 11:48:43.168913 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jun 17 11:48:43.168913 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jun 17 11:48:43.168913 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Id: 2e58eacbbb9e41fdbbb13f5b39be782a Jun 17 11:48:43.168913 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-AttachVolumeNegativeTest-1942846496-project Jun 17 11:48:43.168913 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: method: > Jun 17 11:48:43.168913 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: exception: Instance 52cfb97a-c546-496a-9557-1663ada483b3 could not be found. Jun 17 11:48:43.168913 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: action_args: {'id': '52cfb97a-c546-496a-9557-1663ada483b3'} Jun 17 11:48:43.169733 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:48:43.169733 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:43.169733 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:48:43.169733 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:48:43.169733 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:48:43.169733 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:48:43.169733 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:48:43.169733 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:48:43.169733 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:48:43.169733 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:48:43.169733 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52cfb97a-c546-496a-9557-1663ada483b3 could not be found. Jun 17 11:48:43.169733 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:43.169733 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:43.169733 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:43.169733 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:43.169733 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:43.169733 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:43.169733 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:48:43.169733 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:48:43.169733 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:48:43.170979 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:48:43.170979 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 11:48:43.170979 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 11:48:43.170979 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 11:48:43.170979 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 11:48:43.170979 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:48:43.170979 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:48:43.170979 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:48:43.170979 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:48:43.170979 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52cfb97a-c546-496a-9557-1663ada483b3 could not be found. Jun 17 11:48:43.170979 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:43.170979 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:43.170979 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:43.170979 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:43.170979 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:43.170979 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:43.170979 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:48:43.170979 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:48:43.170979 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52cfb97a-c546-496a-9557-1663ada483b3 could not be found. Jun 17 11:48:43.170979 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:43.172266 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1edb4648-3492-49ec-bac9-5be6a6fcfbd8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Returning 404 to user: Instance 52cfb97a-c546-496a-9557-1663ada483b3 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:48:43.172266 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-1edb4648-3492-49ec-bac9-5be6a6fcfbd8 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "DELETE /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3" status: 404 len: 111 microversion: 2.1 time: 0.031362 Jun 17 11:48:43.172266 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 449/904] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 17 11:48:43 2022] DELETE /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:48:43.178829 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a0b341e9-fbe7-43fb-bc87-81a05b5d5a6e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:43.179666 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a0b341e9-fbe7-43fb-bc87-81a05b5d5a6e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 52cfb97a-c546-496a-9557-1663ada483b3] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:43.186442 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a0b341e9-fbe7-43fb-bc87-81a05b5d5a6e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:43.186903 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a0b341e9-fbe7-43fb-bc87-81a05b5d5a6e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:43.187697 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a0b341e9-fbe7-43fb-bc87-81a05b5d5a6e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:43.188160 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a0b341e9-fbe7-43fb-bc87-81a05b5d5a6e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:43.202761 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-a0b341e9-fbe7-43fb-bc87-81a05b5d5a6e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] HTTP exception thrown: Instance 52cfb97a-c546-496a-9557-1663ada483b3 could not be found. Jun 17 11:48:43.204474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a0b341e9-fbe7-43fb-bc87-81a05b5d5a6e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Request method failure captured: Jun 17 11:48:43.204474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3 HTTP/1.1 Jun 17 11:48:43.204474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jun 17 11:48:43.204474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jun 17 11:48:43.204474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Connection: close Jun 17 11:48:43.204474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jun 17 11:48:43.204474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jun 17 11:48:43.204474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.45 Jun 17 11:48:43.204474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jun 17 11:48:43.204474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jun 17 11:48:43.204474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABirGhbQZN58Mc4zyhUveG-Q-SFsZYiqbX0gxyltnPVCjSfEYNyfXfhfVCx5KdbK5qhE4EnaiOrUEMOKAhCCD_-tiKGRwJFUZvlEPvpBXY3_SY-UVihK6NaeFSNbrNpsHezSsj02ro8zcS2-cKoHlRfS3nCqLWBYJ5x0JyaHmYJlkw7b68 Jun 17 11:48:43.204474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jun 17 11:48:43.204474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jun 17 11:48:43.204474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jun 17 11:48:43.204474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jun 17 11:48:43.204474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jun 17 11:48:43.204474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jun 17 11:48:43.204474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Id: c58cf63264414f30a98161f6027daad0 Jun 17 11:48:43.204474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:48:43.204474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jun 17 11:48:43.204474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jun 17 11:48:43.206350 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c58cf63264414f30a98161f6027daad0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c58cf63264414f30a98161f6027daad0", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c58cf63264414f30a98161f6027daad0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c58cf63264414f30a98161f6027daad0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:48:43.206350 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:48:43.206350 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: c58cf63264414f30a98161f6027daad0 Jun 17 11:48:43.206350 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:48:43.206350 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User: tempest-AttachVolumeNegativeTest-1942846496-project Jun 17 11:48:43.206350 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jun 17 11:48:43.206350 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jun 17 11:48:43.206350 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Id: 2e58eacbbb9e41fdbbb13f5b39be782a Jun 17 11:48:43.206350 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-AttachVolumeNegativeTest-1942846496-project Jun 17 11:48:43.206350 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: method: > Jun 17 11:48:43.206350 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: exception: Instance 52cfb97a-c546-496a-9557-1663ada483b3 could not be found. Jun 17 11:48:43.206350 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: action_args: {'id': '52cfb97a-c546-496a-9557-1663ada483b3'} Jun 17 11:48:43.207246 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:48:43.207246 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:43.207246 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:48:43.207246 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:48:43.207246 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:48:43.207246 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:48:43.207246 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:48:43.207246 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:48:43.207246 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:48:43.207246 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:48:43.207246 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52cfb97a-c546-496a-9557-1663ada483b3 could not be found. Jun 17 11:48:43.207246 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:43.207246 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:43.207246 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:43.207246 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:43.207246 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:43.207246 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:43.207246 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:48:43.207246 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:48:43.207246 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:48:43.210134 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:48:43.210134 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 11:48:43.210134 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 11:48:43.210134 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:48:43.210134 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:48:43.210134 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:48:43.210134 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:48:43.210134 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52cfb97a-c546-496a-9557-1663ada483b3 could not be found. Jun 17 11:48:43.210134 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:43.210134 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:43.210134 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:43.210134 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:43.210134 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:43.210134 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:43.210134 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:48:43.210134 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:48:43.210134 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52cfb97a-c546-496a-9557-1663ada483b3 could not be found. Jun 17 11:48:43.210134 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:43.211931 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a0b341e9-fbe7-43fb-bc87-81a05b5d5a6e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Returning 404 to user: Instance 52cfb97a-c546-496a-9557-1663ada483b3 could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:48:43.211931 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a0b341e9-fbe7-43fb-bc87-81a05b5d5a6e tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3" status: 404 len: 111 microversion: 2.1 time: 0.032218 Jun 17 11:48:43.211931 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 456/905] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:43 2022] GET /compute/v2.1/servers/52cfb97a-c546-496a-9557-1663ada483b3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:48:43.399853 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-0d945d46-31aa-4a04-8e16-e2197ba7b2ed tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:48:43.400715 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-0d945d46-31aa-4a04-8e16-e2197ba7b2ed tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:43.413559 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0d945d46-31aa-4a04-8e16-e2197ba7b2ed tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:43.414362 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0d945d46-31aa-4a04-8e16-e2197ba7b2ed tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:43.415859 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0d945d46-31aa-4a04-8e16-e2197ba7b2ed tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:43.416627 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0d945d46-31aa-4a04-8e16-e2197ba7b2ed tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:43.461259 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-0d945d46-31aa-4a04-8e16-e2197ba7b2ed tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lazy-loading 'flavor' on Instance uuid ef2e4aca-bc09-41dd-9f63-3a8649cf871c {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:48:43.879907 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-0d945d46-31aa-4a04-8e16-e2197ba7b2ed tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "POST /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c/action" status: 202 len: 0 microversion: 2.1 time: 0.487674 Jun 17 11:48:43.880664 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 450/906] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jun 17 11:48:43 2022] POST /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 11:48:43.889528 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a9eeacb0-7179-419d-902b-2ac4c11b73b4 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:43.890151 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a9eeacb0-7179-419d-902b-2ac4c11b73b4 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:43.896608 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a9eeacb0-7179-419d-902b-2ac4c11b73b4 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:43.901357 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a9eeacb0-7179-419d-902b-2ac4c11b73b4 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:43.901357 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a9eeacb0-7179-419d-902b-2ac4c11b73b4 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:43.901357 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a9eeacb0-7179-419d-902b-2ac4c11b73b4 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:44.051207 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a9eeacb0-7179-419d-902b-2ac4c11b73b4 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:44.059185 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a9eeacb0-7179-419d-902b-2ac4c11b73b4 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1566 microversion: 2.1 time: 0.173573 Jun 17 11:48:44.059955 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 457/907] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:43 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:48:44.496474 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b2e81d91-f13c-4d8f-a0da-4941dfd06e55 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:44.497101 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b2e81d91-f13c-4d8f-a0da-4941dfd06e55 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:44.503558 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b2e81d91-f13c-4d8f-a0da-4941dfd06e55 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:44.504000 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b2e81d91-f13c-4d8f-a0da-4941dfd06e55 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:44.504782 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b2e81d91-f13c-4d8f-a0da-4941dfd06e55 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:44.505187 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b2e81d91-f13c-4d8f-a0da-4941dfd06e55 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:44.520142 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-b2e81d91-f13c-4d8f-a0da-4941dfd06e55 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] HTTP exception thrown: Instance 4b705046-ed66-4a09-9354-18ee01d1676b could not be found. Jun 17 11:48:44.521806 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b2e81d91-f13c-4d8f-a0da-4941dfd06e55 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Request method failure captured: Jun 17 11:48:44.521806 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: request: DELETE /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b HTTP/1.1 Jun 17 11:48:44.521806 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept: application/json Jun 17 11:48:44.521806 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jun 17 11:48:44.521806 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Connection: close Jun 17 11:48:44.521806 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jun 17 11:48:44.521806 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jun 17 11:48:44.521806 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Host: 10.222.0.45 Jun 17 11:48:44.521806 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jun 17 11:48:44.521806 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jun 17 11:48:44.521806 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABirGhbQZN58Mc4zyhUveG-Q-SFsZYiqbX0gxyltnPVCjSfEYNyfXfhfVCx5KdbK5qhE4EnaiOrUEMOKAhCCD_-tiKGRwJFUZvlEPvpBXY3_SY-UVihK6NaeFSNbrNpsHezSsj02ro8zcS2-cKoHlRfS3nCqLWBYJ5x0JyaHmYJlkw7b68 Jun 17 11:48:44.521806 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jun 17 11:48:44.521806 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jun 17 11:48:44.521806 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jun 17 11:48:44.521806 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jun 17 11:48:44.521806 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jun 17 11:48:44.521806 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jun 17 11:48:44.521806 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Id: c58cf63264414f30a98161f6027daad0 Jun 17 11:48:44.521806 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:48:44.521806 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Role: member,reader Jun 17 11:48:44.521806 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Roles: member,reader Jun 17 11:48:44.524561 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c58cf63264414f30a98161f6027daad0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c58cf63264414f30a98161f6027daad0", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c58cf63264414f30a98161f6027daad0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c58cf63264414f30a98161f6027daad0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:48:44.524561 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:48:44.524561 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Id: c58cf63264414f30a98161f6027daad0 Jun 17 11:48:44.524561 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:48:44.524561 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User: tempest-AttachVolumeNegativeTest-1942846496-project Jun 17 11:48:44.524561 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jun 17 11:48:44.524561 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jun 17 11:48:44.524561 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Id: 2e58eacbbb9e41fdbbb13f5b39be782a Jun 17 11:48:44.524561 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-AttachVolumeNegativeTest-1942846496-project Jun 17 11:48:44.524561 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: method: > Jun 17 11:48:44.524561 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: exception: Instance 4b705046-ed66-4a09-9354-18ee01d1676b could not be found. Jun 17 11:48:44.524561 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: action_args: {'id': '4b705046-ed66-4a09-9354-18ee01d1676b'} Jun 17 11:48:44.525489 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:48:44.525489 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:44.525489 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:48:44.525489 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:48:44.525489 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:48:44.525489 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:48:44.525489 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:48:44.525489 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:48:44.525489 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:48:44.525489 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:48:44.525489 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b705046-ed66-4a09-9354-18ee01d1676b could not be found. Jun 17 11:48:44.525489 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:44.525489 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:44.525489 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:44.525489 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:44.525489 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:44.525489 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:44.525489 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:48:44.525489 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:48:44.525489 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:48:44.526943 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:48:44.526943 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 11:48:44.526943 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 11:48:44.526943 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 11:48:44.526943 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 11:48:44.526943 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:48:44.526943 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:48:44.526943 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:48:44.526943 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:48:44.526943 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b705046-ed66-4a09-9354-18ee01d1676b could not be found. Jun 17 11:48:44.526943 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:44.526943 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:44.526943 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:44.526943 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:44.526943 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:44.526943 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:44.526943 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:48:44.526943 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:48:44.526943 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b705046-ed66-4a09-9354-18ee01d1676b could not be found. Jun 17 11:48:44.526943 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:44.528462 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b2e81d91-f13c-4d8f-a0da-4941dfd06e55 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Returning 404 to user: Instance 4b705046-ed66-4a09-9354-18ee01d1676b could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:48:44.528462 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b2e81d91-f13c-4d8f-a0da-4941dfd06e55 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b" status: 404 len: 111 microversion: 2.1 time: 0.032346 Jun 17 11:48:44.528462 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 451/908] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 17 11:48:44 2022] DELETE /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:48:44.533700 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-92fe5e60-b4ec-4ae3-a159-f64c4c002820 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:44.534332 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-92fe5e60-b4ec-4ae3-a159-f64c4c002820 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: 4b705046-ed66-4a09-9354-18ee01d1676b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:44.541816 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-92fe5e60-b4ec-4ae3-a159-f64c4c002820 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:44.542274 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-92fe5e60-b4ec-4ae3-a159-f64c4c002820 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:44.547584 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-92fe5e60-b4ec-4ae3-a159-f64c4c002820 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:44.547584 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-92fe5e60-b4ec-4ae3-a159-f64c4c002820 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:44.557449 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-92fe5e60-b4ec-4ae3-a159-f64c4c002820 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] HTTP exception thrown: Instance 4b705046-ed66-4a09-9354-18ee01d1676b could not be found. Jun 17 11:48:44.559042 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-92fe5e60-b4ec-4ae3-a159-f64c4c002820 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Request method failure captured: Jun 17 11:48:44.559042 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b HTTP/1.1 Jun 17 11:48:44.559042 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jun 17 11:48:44.559042 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jun 17 11:48:44.559042 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Connection: close Jun 17 11:48:44.559042 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jun 17 11:48:44.559042 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jun 17 11:48:44.559042 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.45 Jun 17 11:48:44.559042 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jun 17 11:48:44.559042 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jun 17 11:48:44.559042 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABirGhbQZN58Mc4zyhUveG-Q-SFsZYiqbX0gxyltnPVCjSfEYNyfXfhfVCx5KdbK5qhE4EnaiOrUEMOKAhCCD_-tiKGRwJFUZvlEPvpBXY3_SY-UVihK6NaeFSNbrNpsHezSsj02ro8zcS2-cKoHlRfS3nCqLWBYJ5x0JyaHmYJlkw7b68 Jun 17 11:48:44.559042 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jun 17 11:48:44.559042 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jun 17 11:48:44.559042 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jun 17 11:48:44.559042 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jun 17 11:48:44.559042 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jun 17 11:48:44.559042 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jun 17 11:48:44.559042 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Id: c58cf63264414f30a98161f6027daad0 Jun 17 11:48:44.559042 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:48:44.559042 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jun 17 11:48:44.559042 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jun 17 11:48:44.560694 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c58cf63264414f30a98161f6027daad0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c58cf63264414f30a98161f6027daad0", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c58cf63264414f30a98161f6027daad0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c58cf63264414f30a98161f6027daad0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:48:44.560694 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:48:44.560694 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: c58cf63264414f30a98161f6027daad0 Jun 17 11:48:44.560694 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:48:44.560694 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User: tempest-AttachVolumeNegativeTest-1942846496-project Jun 17 11:48:44.560694 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jun 17 11:48:44.560694 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jun 17 11:48:44.560694 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Id: 2e58eacbbb9e41fdbbb13f5b39be782a Jun 17 11:48:44.560694 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-AttachVolumeNegativeTest-1942846496-project Jun 17 11:48:44.560694 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: method: > Jun 17 11:48:44.560694 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: exception: Instance 4b705046-ed66-4a09-9354-18ee01d1676b could not be found. Jun 17 11:48:44.560694 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: action_args: {'id': '4b705046-ed66-4a09-9354-18ee01d1676b'} Jun 17 11:48:44.561577 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:48:44.561577 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:44.561577 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:48:44.561577 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:48:44.561577 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:48:44.561577 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:48:44.561577 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:48:44.561577 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:48:44.561577 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:48:44.561577 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:48:44.561577 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b705046-ed66-4a09-9354-18ee01d1676b could not be found. Jun 17 11:48:44.561577 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:44.561577 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:44.561577 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:44.561577 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:44.561577 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:44.561577 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:44.561577 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:48:44.561577 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:48:44.561577 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:48:44.563109 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:48:44.563109 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 11:48:44.563109 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 11:48:44.563109 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:48:44.563109 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:48:44.563109 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:48:44.563109 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:48:44.563109 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b705046-ed66-4a09-9354-18ee01d1676b could not be found. Jun 17 11:48:44.563109 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:44.563109 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:44.563109 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:44.563109 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:44.563109 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:44.563109 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:44.563109 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:48:44.563109 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:48:44.563109 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b705046-ed66-4a09-9354-18ee01d1676b could not be found. Jun 17 11:48:44.563109 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:44.565456 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-92fe5e60-b4ec-4ae3-a159-f64c4c002820 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Returning 404 to user: Instance 4b705046-ed66-4a09-9354-18ee01d1676b could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:48:44.565456 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-92fe5e60-b4ec-4ae3-a159-f64c4c002820 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b" status: 404 len: 111 microversion: 2.1 time: 0.030862 Jun 17 11:48:44.565456 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 458/909] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:44 2022] GET /compute/v2.1/servers/4b705046-ed66-4a09-9354-18ee01d1676b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:48:44.569157 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-30f66a69-10f1-4cff-b003-629e8ea1147d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:44.570316 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-30f66a69-10f1-4cff-b003-629e8ea1147d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: a8d94a32-3230-4516-9233-fa758d450798] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:44.576749 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-30f66a69-10f1-4cff-b003-629e8ea1147d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:44.577203 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-30f66a69-10f1-4cff-b003-629e8ea1147d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:44.577980 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-30f66a69-10f1-4cff-b003-629e8ea1147d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:44.578419 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-30f66a69-10f1-4cff-b003-629e8ea1147d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:44.599408 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-30f66a69-10f1-4cff-b003-629e8ea1147d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] HTTP exception thrown: Instance a8d94a32-3230-4516-9233-fa758d450798 could not be found. Jun 17 11:48:44.604800 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-30f66a69-10f1-4cff-b003-629e8ea1147d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Request method failure captured: Jun 17 11:48:44.604800 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: request: DELETE /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798 HTTP/1.1 Jun 17 11:48:44.604800 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept: application/json Jun 17 11:48:44.604800 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jun 17 11:48:44.604800 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Connection: close Jun 17 11:48:44.604800 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jun 17 11:48:44.604800 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jun 17 11:48:44.604800 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Host: 10.222.0.45 Jun 17 11:48:44.604800 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jun 17 11:48:44.604800 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jun 17 11:48:44.604800 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABirGhbQZN58Mc4zyhUveG-Q-SFsZYiqbX0gxyltnPVCjSfEYNyfXfhfVCx5KdbK5qhE4EnaiOrUEMOKAhCCD_-tiKGRwJFUZvlEPvpBXY3_SY-UVihK6NaeFSNbrNpsHezSsj02ro8zcS2-cKoHlRfS3nCqLWBYJ5x0JyaHmYJlkw7b68 Jun 17 11:48:44.604800 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jun 17 11:48:44.604800 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jun 17 11:48:44.604800 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jun 17 11:48:44.604800 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jun 17 11:48:44.604800 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jun 17 11:48:44.604800 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jun 17 11:48:44.604800 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Id: c58cf63264414f30a98161f6027daad0 Jun 17 11:48:44.604800 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:48:44.604800 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Role: member,reader Jun 17 11:48:44.604800 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Roles: member,reader Jun 17 11:48:44.607234 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c58cf63264414f30a98161f6027daad0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c58cf63264414f30a98161f6027daad0", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c58cf63264414f30a98161f6027daad0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c58cf63264414f30a98161f6027daad0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:48:44.607234 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:48:44.607234 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Id: c58cf63264414f30a98161f6027daad0 Jun 17 11:48:44.607234 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:48:44.607234 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User: tempest-AttachVolumeNegativeTest-1942846496-project Jun 17 11:48:44.607234 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jun 17 11:48:44.607234 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jun 17 11:48:44.607234 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Id: 2e58eacbbb9e41fdbbb13f5b39be782a Jun 17 11:48:44.607234 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-AttachVolumeNegativeTest-1942846496-project Jun 17 11:48:44.607234 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: method: > Jun 17 11:48:44.607234 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: exception: Instance a8d94a32-3230-4516-9233-fa758d450798 could not be found. Jun 17 11:48:44.607234 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: action_args: {'id': 'a8d94a32-3230-4516-9233-fa758d450798'} Jun 17 11:48:44.608061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:48:44.608061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:44.608061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:48:44.608061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:48:44.608061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:48:44.608061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:48:44.608061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:48:44.608061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:48:44.608061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:48:44.608061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:48:44.608061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8d94a32-3230-4516-9233-fa758d450798 could not be found. Jun 17 11:48:44.608061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:44.608061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:44.608061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:44.608061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:44.608061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:44.608061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:44.608061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:48:44.608061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:48:44.608061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:48:44.609474 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:48:44.609474 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 11:48:44.609474 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 11:48:44.609474 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 11:48:44.609474 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 11:48:44.609474 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:48:44.609474 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:48:44.609474 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:48:44.609474 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:48:44.609474 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8d94a32-3230-4516-9233-fa758d450798 could not be found. Jun 17 11:48:44.609474 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:44.609474 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:44.609474 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:44.609474 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:44.609474 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:44.609474 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:44.609474 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:48:44.609474 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:48:44.609474 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8d94a32-3230-4516-9233-fa758d450798 could not be found. Jun 17 11:48:44.609474 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:44.618207 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-30f66a69-10f1-4cff-b003-629e8ea1147d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Returning 404 to user: Instance a8d94a32-3230-4516-9233-fa758d450798 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:48:44.618207 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-30f66a69-10f1-4cff-b003-629e8ea1147d tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798" status: 404 len: 111 microversion: 2.1 time: 0.037944 Jun 17 11:48:44.618207 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 452/910] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 17 11:48:44 2022] DELETE /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 11:48:44.618470 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-549d88a1-3856-409e-89fd-2c743ef3cd83 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:44.618690 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-549d88a1-3856-409e-89fd-2c743ef3cd83 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: a8d94a32-3230-4516-9233-fa758d450798] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:44.625526 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-549d88a1-3856-409e-89fd-2c743ef3cd83 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:44.626236 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-549d88a1-3856-409e-89fd-2c743ef3cd83 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:44.627022 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-549d88a1-3856-409e-89fd-2c743ef3cd83 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:44.627552 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-549d88a1-3856-409e-89fd-2c743ef3cd83 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:44.642578 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-549d88a1-3856-409e-89fd-2c743ef3cd83 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] HTTP exception thrown: Instance a8d94a32-3230-4516-9233-fa758d450798 could not be found. Jun 17 11:48:44.644179 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-549d88a1-3856-409e-89fd-2c743ef3cd83 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Request method failure captured: Jun 17 11:48:44.644179 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798 HTTP/1.1 Jun 17 11:48:44.644179 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jun 17 11:48:44.644179 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jun 17 11:48:44.644179 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Connection: close Jun 17 11:48:44.644179 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jun 17 11:48:44.644179 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jun 17 11:48:44.644179 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.45 Jun 17 11:48:44.644179 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jun 17 11:48:44.644179 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jun 17 11:48:44.644179 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABirGhbQZN58Mc4zyhUveG-Q-SFsZYiqbX0gxyltnPVCjSfEYNyfXfhfVCx5KdbK5qhE4EnaiOrUEMOKAhCCD_-tiKGRwJFUZvlEPvpBXY3_SY-UVihK6NaeFSNbrNpsHezSsj02ro8zcS2-cKoHlRfS3nCqLWBYJ5x0JyaHmYJlkw7b68 Jun 17 11:48:44.644179 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jun 17 11:48:44.644179 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jun 17 11:48:44.644179 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jun 17 11:48:44.644179 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jun 17 11:48:44.644179 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jun 17 11:48:44.644179 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jun 17 11:48:44.644179 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Id: c58cf63264414f30a98161f6027daad0 Jun 17 11:48:44.644179 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:48:44.644179 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jun 17 11:48:44.644179 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jun 17 11:48:44.645806 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c58cf63264414f30a98161f6027daad0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c58cf63264414f30a98161f6027daad0", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c58cf63264414f30a98161f6027daad0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c58cf63264414f30a98161f6027daad0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:48:44.645806 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:48:44.645806 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: c58cf63264414f30a98161f6027daad0 Jun 17 11:48:44.645806 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:48:44.645806 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User: tempest-AttachVolumeNegativeTest-1942846496-project Jun 17 11:48:44.645806 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jun 17 11:48:44.645806 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jun 17 11:48:44.645806 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Id: 2e58eacbbb9e41fdbbb13f5b39be782a Jun 17 11:48:44.645806 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-AttachVolumeNegativeTest-1942846496-project Jun 17 11:48:44.645806 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: method: > Jun 17 11:48:44.645806 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: exception: Instance a8d94a32-3230-4516-9233-fa758d450798 could not be found. Jun 17 11:48:44.645806 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: action_args: {'id': 'a8d94a32-3230-4516-9233-fa758d450798'} Jun 17 11:48:44.646755 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:48:44.646755 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:44.646755 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:48:44.646755 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:48:44.646755 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:48:44.646755 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:48:44.646755 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:48:44.646755 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:48:44.646755 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:48:44.646755 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:48:44.646755 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8d94a32-3230-4516-9233-fa758d450798 could not be found. Jun 17 11:48:44.646755 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:44.646755 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:44.646755 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:44.646755 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:44.646755 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:44.646755 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:44.646755 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:48:44.646755 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:48:44.646755 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:48:44.648474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:48:44.648474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 11:48:44.648474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 11:48:44.648474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:48:44.648474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:48:44.648474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:48:44.648474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:48:44.648474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8d94a32-3230-4516-9233-fa758d450798 could not be found. Jun 17 11:48:44.648474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:44.648474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:44.648474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:44.648474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:44.648474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:44.648474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:44.648474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:48:44.648474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:48:44.648474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8d94a32-3230-4516-9233-fa758d450798 could not be found. Jun 17 11:48:44.648474 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:44.649772 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-549d88a1-3856-409e-89fd-2c743ef3cd83 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Returning 404 to user: Instance a8d94a32-3230-4516-9233-fa758d450798 could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:48:44.649772 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-549d88a1-3856-409e-89fd-2c743ef3cd83 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798" status: 404 len: 111 microversion: 2.1 time: 0.034718 Jun 17 11:48:44.649772 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 459/911] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:44 2022] GET /compute/v2.1/servers/a8d94a32-3230-4516-9233-fa758d450798 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:48:45.078019 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-fccbb931-68c9-4900-b61d-df888ce9eea6 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:45.078723 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-fccbb931-68c9-4900-b61d-df888ce9eea6 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:45.085596 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fccbb931-68c9-4900-b61d-df888ce9eea6 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:45.086075 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fccbb931-68c9-4900-b61d-df888ce9eea6 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:45.086978 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fccbb931-68c9-4900-b61d-df888ce9eea6 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:45.087456 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fccbb931-68c9-4900-b61d-df888ce9eea6 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:45.234174 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-fccbb931-68c9-4900-b61d-df888ce9eea6 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:45.242138 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-fccbb931-68c9-4900-b61d-df888ce9eea6 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1566 microversion: 2.1 time: 0.168210 Jun 17 11:48:45.242738 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 453/912] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:45 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:48:45.347900 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-d6747257-e673-4f93-a600-a30a9976d722 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:45.348994 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-d6747257-e673-4f93-a600-a30a9976d722 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:45.356750 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d6747257-e673-4f93-a600-a30a9976d722 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:45.357117 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d6747257-e673-4f93-a600-a30a9976d722 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:45.357972 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d6747257-e673-4f93-a600-a30a9976d722 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:45.358411 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d6747257-e673-4f93-a600-a30a9976d722 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:45.389939 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-d6747257-e673-4f93-a600-a30a9976d722 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046469 Jun 17 11:48:45.390716 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 460/913] 10.222.0.45 () {60 vars in 1342 bytes} [Fri Jun 17 11:48:45 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:48:45.461830 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-acb82368-82a4-46f7-bf1f-fb869af24617 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:45.462324 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-acb82368-82a4-46f7-bf1f-fb869af24617 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:45.468519 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-acb82368-82a4-46f7-bf1f-fb869af24617 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:45.468965 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-acb82368-82a4-46f7-bf1f-fb869af24617 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:45.469749 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-acb82368-82a4-46f7-bf1f-fb869af24617 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:45.470185 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-acb82368-82a4-46f7-bf1f-fb869af24617 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:45.498177 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-acb82368-82a4-46f7-bf1f-fb869af24617 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Going to try to terminate instance {{(pid=124844) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 11:48:45.875575 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-acb82368-82a4-46f7-bf1f-fb869af24617 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 204 len: 0 microversion: 2.20 time: 0.417624 Jun 17 11:48:45.880199 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 454/914] 10.222.0.45 () {60 vars in 1279 bytes} [Fri Jun 17 11:48:45 2022] DELETE /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 17 11:48:45.885791 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-03475c35-a3d6-4e7b-8353-4ef218d53d3a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:45.886495 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-03475c35-a3d6-4e7b-8353-4ef218d53d3a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:45.893518 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-03475c35-a3d6-4e7b-8353-4ef218d53d3a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:45.893970 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-03475c35-a3d6-4e7b-8353-4ef218d53d3a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:45.894739 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-03475c35-a3d6-4e7b-8353-4ef218d53d3a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:45.895170 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-03475c35-a3d6-4e7b-8353-4ef218d53d3a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:45.955494 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-04794382-13d8-4b84-8dc4-f0ec56f569da tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:45.956179 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-04794382-13d8-4b84-8dc4-f0ec56f569da tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: be48aa4e-115e-4d58-8940-f722120f4664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:45.963579 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-04794382-13d8-4b84-8dc4-f0ec56f569da tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:45.963579 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-04794382-13d8-4b84-8dc4-f0ec56f569da tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:45.964163 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-04794382-13d8-4b84-8dc4-f0ec56f569da tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:45.964604 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-04794382-13d8-4b84-8dc4-f0ec56f569da tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:45.980244 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-04794382-13d8-4b84-8dc4-f0ec56f569da tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] HTTP exception thrown: Instance be48aa4e-115e-4d58-8940-f722120f4664 could not be found. Jun 17 11:48:45.982102 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-04794382-13d8-4b84-8dc4-f0ec56f569da tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Request method failure captured: Jun 17 11:48:45.982102 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: request: DELETE /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664 HTTP/1.1 Jun 17 11:48:45.982102 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept: application/json Jun 17 11:48:45.982102 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jun 17 11:48:45.982102 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Connection: close Jun 17 11:48:45.982102 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jun 17 11:48:45.982102 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jun 17 11:48:45.982102 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Host: 10.222.0.45 Jun 17 11:48:45.982102 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jun 17 11:48:45.982102 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jun 17 11:48:45.982102 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABirGhbQZN58Mc4zyhUveG-Q-SFsZYiqbX0gxyltnPVCjSfEYNyfXfhfVCx5KdbK5qhE4EnaiOrUEMOKAhCCD_-tiKGRwJFUZvlEPvpBXY3_SY-UVihK6NaeFSNbrNpsHezSsj02ro8zcS2-cKoHlRfS3nCqLWBYJ5x0JyaHmYJlkw7b68 Jun 17 11:48:45.982102 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jun 17 11:48:45.982102 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jun 17 11:48:45.982102 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jun 17 11:48:45.982102 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jun 17 11:48:45.982102 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jun 17 11:48:45.982102 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jun 17 11:48:45.982102 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Id: c58cf63264414f30a98161f6027daad0 Jun 17 11:48:45.982102 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:48:45.982102 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Role: member,reader Jun 17 11:48:45.982102 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Roles: member,reader Jun 17 11:48:45.983762 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c58cf63264414f30a98161f6027daad0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c58cf63264414f30a98161f6027daad0", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c58cf63264414f30a98161f6027daad0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c58cf63264414f30a98161f6027daad0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:48:45.983762 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:48:45.983762 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Id: c58cf63264414f30a98161f6027daad0 Jun 17 11:48:45.983762 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:48:45.983762 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User: tempest-AttachVolumeNegativeTest-1942846496-project Jun 17 11:48:45.983762 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jun 17 11:48:45.983762 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jun 17 11:48:45.983762 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Id: 2e58eacbbb9e41fdbbb13f5b39be782a Jun 17 11:48:45.983762 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-AttachVolumeNegativeTest-1942846496-project Jun 17 11:48:45.983762 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: method: > Jun 17 11:48:45.983762 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: exception: Instance be48aa4e-115e-4d58-8940-f722120f4664 could not be found. Jun 17 11:48:45.983762 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: action_args: {'id': 'be48aa4e-115e-4d58-8940-f722120f4664'} Jun 17 11:48:45.984609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:48:45.984609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:45.984609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:48:45.984609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:48:45.984609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:48:45.984609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:48:45.984609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:48:45.984609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:48:45.984609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:48:45.984609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:48:45.984609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be48aa4e-115e-4d58-8940-f722120f4664 could not be found. Jun 17 11:48:45.984609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:45.984609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:45.984609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:45.984609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:45.984609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:45.984609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:45.984609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:48:45.984609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:48:45.984609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:48:45.985882 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:48:45.985882 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 11:48:45.985882 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 11:48:45.985882 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 11:48:45.985882 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 11:48:45.985882 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:48:45.985882 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:48:45.985882 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:48:45.985882 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:48:45.985882 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be48aa4e-115e-4d58-8940-f722120f4664 could not be found. Jun 17 11:48:45.985882 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:45.985882 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:45.985882 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:45.985882 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:45.985882 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:45.985882 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:45.985882 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:48:45.985882 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:48:45.985882 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be48aa4e-115e-4d58-8940-f722120f4664 could not be found. Jun 17 11:48:45.985882 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:45.987089 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-04794382-13d8-4b84-8dc4-f0ec56f569da tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Returning 404 to user: Instance be48aa4e-115e-4d58-8940-f722120f4664 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:48:45.987089 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-04794382-13d8-4b84-8dc4-f0ec56f569da tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "DELETE /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664" status: 404 len: 111 microversion: 2.1 time: 0.032366 Jun 17 11:48:45.987089 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 455/915] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 17 11:48:45 2022] DELETE /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 11:48:45.992481 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-514606b0-2a38-4f8d-8a1b-30a0da1dc874 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:45.993089 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-514606b0-2a38-4f8d-8a1b-30a0da1dc874 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] [instance: be48aa4e-115e-4d58-8940-f722120f4664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:45.999460 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-514606b0-2a38-4f8d-8a1b-30a0da1dc874 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:45.999892 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-514606b0-2a38-4f8d-8a1b-30a0da1dc874 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:46.000723 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-514606b0-2a38-4f8d-8a1b-30a0da1dc874 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:46.001355 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-514606b0-2a38-4f8d-8a1b-30a0da1dc874 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:46.016214 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-514606b0-2a38-4f8d-8a1b-30a0da1dc874 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] HTTP exception thrown: Instance be48aa4e-115e-4d58-8940-f722120f4664 could not be found. Jun 17 11:48:46.017857 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-514606b0-2a38-4f8d-8a1b-30a0da1dc874 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Request method failure captured: Jun 17 11:48:46.017857 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: request: GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664 HTTP/1.1 Jun 17 11:48:46.017857 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept: application/json Jun 17 11:48:46.017857 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jun 17 11:48:46.017857 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Connection: close Jun 17 11:48:46.017857 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jun 17 11:48:46.017857 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jun 17 11:48:46.017857 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Host: 10.222.0.45 Jun 17 11:48:46.017857 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jun 17 11:48:46.017857 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jun 17 11:48:46.017857 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABirGhbQZN58Mc4zyhUveG-Q-SFsZYiqbX0gxyltnPVCjSfEYNyfXfhfVCx5KdbK5qhE4EnaiOrUEMOKAhCCD_-tiKGRwJFUZvlEPvpBXY3_SY-UVihK6NaeFSNbrNpsHezSsj02ro8zcS2-cKoHlRfS3nCqLWBYJ5x0JyaHmYJlkw7b68 Jun 17 11:48:46.017857 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jun 17 11:48:46.017857 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jun 17 11:48:46.017857 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jun 17 11:48:46.017857 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jun 17 11:48:46.017857 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jun 17 11:48:46.017857 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jun 17 11:48:46.017857 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Id: c58cf63264414f30a98161f6027daad0 Jun 17 11:48:46.017857 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:48:46.017857 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Role: member,reader Jun 17 11:48:46.017857 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Roles: member,reader Jun 17 11:48:46.020315 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c58cf63264414f30a98161f6027daad0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c58cf63264414f30a98161f6027daad0", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c58cf63264414f30a98161f6027daad0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c58cf63264414f30a98161f6027daad0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:48:46.020315 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:48:46.020315 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Id: c58cf63264414f30a98161f6027daad0 Jun 17 11:48:46.020315 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1942846496 Jun 17 11:48:46.020315 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User: tempest-AttachVolumeNegativeTest-1942846496-project Jun 17 11:48:46.020315 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jun 17 11:48:46.020315 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jun 17 11:48:46.020315 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Id: 2e58eacbbb9e41fdbbb13f5b39be782a Jun 17 11:48:46.020315 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-AttachVolumeNegativeTest-1942846496-project Jun 17 11:48:46.020315 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: method: > Jun 17 11:48:46.020315 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: exception: Instance be48aa4e-115e-4d58-8940-f722120f4664 could not be found. Jun 17 11:48:46.020315 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: action_args: {'id': 'be48aa4e-115e-4d58-8940-f722120f4664'} Jun 17 11:48:46.021214 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:48:46.021214 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:46.021214 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:48:46.021214 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:48:46.021214 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:48:46.021214 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:48:46.021214 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:48:46.021214 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:48:46.021214 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:48:46.021214 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:48:46.021214 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be48aa4e-115e-4d58-8940-f722120f4664 could not be found. Jun 17 11:48:46.021214 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:46.021214 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:46.021214 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:46.021214 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:46.021214 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:46.021214 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:46.021214 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:48:46.021214 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:48:46.021214 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:48:46.022794 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:48:46.022794 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 11:48:46.022794 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 11:48:46.022794 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:48:46.022794 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:48:46.022794 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:48:46.022794 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:48:46.022794 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be48aa4e-115e-4d58-8940-f722120f4664 could not be found. Jun 17 11:48:46.022794 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:46.022794 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:46.022794 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:46.022794 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:46.022794 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:46.022794 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:46.022794 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:48:46.022794 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:48:46.022794 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be48aa4e-115e-4d58-8940-f722120f4664 could not be found. Jun 17 11:48:46.022794 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:46.025080 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-514606b0-2a38-4f8d-8a1b-30a0da1dc874 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] Returning 404 to user: Instance be48aa4e-115e-4d58-8940-f722120f4664 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:48:46.025080 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-514606b0-2a38-4f8d-8a1b-30a0da1dc874 tempest-AttachVolumeNegativeTest-1942846496 tempest-AttachVolumeNegativeTest-1942846496-project] 10.222.0.45 "GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664" status: 404 len: 111 microversion: 2.1 time: 0.031301 Jun 17 11:48:46.025080 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 456/916] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:45 2022] GET /compute/v2.1/servers/be48aa4e-115e-4d58-8940-f722120f4664 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 11:48:46.043391 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-03475c35-a3d6-4e7b-8353-4ef218d53d3a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:46.051984 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-03475c35-a3d6-4e7b-8353-4ef218d53d3a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:46.053527 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-03475c35-a3d6-4e7b-8353-4ef218d53d3a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:46.055892 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-03475c35-a3d6-4e7b-8353-4ef218d53d3a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1723 microversion: 2.20 time: 0.174695 Jun 17 11:48:46.056461 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 461/917] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:48:45 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:48:46.268905 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a0cfcd3f-3352-4d80-b876-f79bef42ff7d tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:46.269678 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a0cfcd3f-3352-4d80-b876-f79bef42ff7d tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:46.280441 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a0cfcd3f-3352-4d80-b876-f79bef42ff7d tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:46.281242 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a0cfcd3f-3352-4d80-b876-f79bef42ff7d tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:46.282713 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a0cfcd3f-3352-4d80-b876-f79bef42ff7d tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:46.283521 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a0cfcd3f-3352-4d80-b876-f79bef42ff7d tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:46.455775 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a0cfcd3f-3352-4d80-b876-f79bef42ff7d tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:46.464295 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a0cfcd3f-3352-4d80-b876-f79bef42ff7d tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1566 microversion: 2.1 time: 0.200528 Jun 17 11:48:46.464888 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 457/918] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:46 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1566 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:48:47.074971 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6cfe7c3f-ef61-4997-9175-94734a4ff95f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:47.075702 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-6cfe7c3f-ef61-4997-9175-94734a4ff95f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:47.082288 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6cfe7c3f-ef61-4997-9175-94734a4ff95f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:47.089400 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6cfe7c3f-ef61-4997-9175-94734a4ff95f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:47.089400 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6cfe7c3f-ef61-4997-9175-94734a4ff95f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:47.089400 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6cfe7c3f-ef61-4997-9175-94734a4ff95f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:47.245452 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6cfe7c3f-ef61-4997-9175-94734a4ff95f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:47.254803 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6cfe7c3f-ef61-4997-9175-94734a4ff95f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:47.258813 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6cfe7c3f-ef61-4997-9175-94734a4ff95f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:47.259970 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-6cfe7c3f-ef61-4997-9175-94734a4ff95f tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1723 microversion: 2.20 time: 0.189280 Jun 17 11:48:47.260622 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 462/919] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:48:47 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:48:47.483998 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-116d9358-e96c-4482-838c-518839fd1e6a tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:47.485376 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-116d9358-e96c-4482-838c-518839fd1e6a tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:47.502449 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-116d9358-e96c-4482-838c-518839fd1e6a tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:47.502449 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-116d9358-e96c-4482-838c-518839fd1e6a tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:47.502449 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-116d9358-e96c-4482-838c-518839fd1e6a tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:47.502449 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-116d9358-e96c-4482-838c-518839fd1e6a tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:47.514621 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:48:47.675781 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-116d9358-e96c-4482-838c-518839fd1e6a tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:47.688152 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-116d9358-e96c-4482-838c-518839fd1e6a tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1566 microversion: 2.1 time: 0.208263 Jun 17 11:48:47.689140 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 458/920] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:47 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1566 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:48:48.281693 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-fc327368-eb9b-484d-8415-14526477a76e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:48.282936 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-fc327368-eb9b-484d-8415-14526477a76e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:48.290478 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fc327368-eb9b-484d-8415-14526477a76e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:48.290478 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fc327368-eb9b-484d-8415-14526477a76e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:48.292487 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fc327368-eb9b-484d-8415-14526477a76e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:48.292487 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fc327368-eb9b-484d-8415-14526477a76e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:48.469288 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-fc327368-eb9b-484d-8415-14526477a76e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:48.480666 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-fc327368-eb9b-484d-8415-14526477a76e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:48.482189 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-fc327368-eb9b-484d-8415-14526477a76e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:48.483397 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-fc327368-eb9b-484d-8415-14526477a76e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1723 microversion: 2.20 time: 0.206548 Jun 17 11:48:48.484030 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 463/921] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:48:48 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 11:48:48.706560 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-28c29ac8-47cd-409e-8091-26ea5825ae9e tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:48.707886 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-28c29ac8-47cd-409e-8091-26ea5825ae9e tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:48.718146 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-28c29ac8-47cd-409e-8091-26ea5825ae9e tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:48.718800 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-28c29ac8-47cd-409e-8091-26ea5825ae9e tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:48.719844 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-28c29ac8-47cd-409e-8091-26ea5825ae9e tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:48.720489 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-28c29ac8-47cd-409e-8091-26ea5825ae9e tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:49.183418 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-28c29ac8-47cd-409e-8091-26ea5825ae9e tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:49.194529 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-28c29ac8-47cd-409e-8091-26ea5825ae9e tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1566 microversion: 2.1 time: 0.492351 Jun 17 11:48:49.197191 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 459/922] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:48 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1566 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:48:49.433155 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-f992a724-5610-4986-9dd1-407657d88be5 req-4ac3808a-2393-4cde-9774-150021d2a51e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4eb9c8c-b733-475e-b69e-279e9295ac4d", "name": "network-vif-deleted", "tag": "f00e28a8-041d-4c99-8685-2e89673ad6b8"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:48:49.444361 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-f992a724-5610-4986-9dd1-407657d88be5 req-4ac3808a-2393-4cde-9774-150021d2a51e service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:49.445324 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-f992a724-5610-4986-9dd1-407657d88be5 req-4ac3808a-2393-4cde-9774-150021d2a51e service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:49.469674 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-f992a724-5610-4986-9dd1-407657d88be5 req-4ac3808a-2393-4cde-9774-150021d2a51e service nova] Creating event network-vif-deleted:f00e28a8-041d-4c99-8685-2e89673ad6b8 for instance f4eb9c8c-b733-475e-b69e-279e9295ac4d on hv-cinder-83716 Jun 17 11:48:49.486757 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-f992a724-5610-4986-9dd1-407657d88be5 req-4ac3808a-2393-4cde-9774-150021d2a51e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048649 Jun 17 11:48:49.486757 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 464/923] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:48:49.503140 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6ccfb815-0ed1-4239-b67c-37ad9efb7c6e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:49.503793 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-6ccfb815-0ed1-4239-b67c-37ad9efb7c6e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:49.512804 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6ccfb815-0ed1-4239-b67c-37ad9efb7c6e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:49.513694 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6ccfb815-0ed1-4239-b67c-37ad9efb7c6e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:49.514068 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6ccfb815-0ed1-4239-b67c-37ad9efb7c6e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:49.514598 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6ccfb815-0ed1-4239-b67c-37ad9efb7c6e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:49.586877 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-6ccfb815-0ed1-4239-b67c-37ad9efb7c6e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:49.596266 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-6ccfb815-0ed1-4239-b67c-37ad9efb7c6e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:49.597888 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-6ccfb815-0ed1-4239-b67c-37ad9efb7c6e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd817bad669fc4d6f829bf6eb57773b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8dc1335e284eee8cca45d5720d5f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:49.599168 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-6ccfb815-0ed1-4239-b67c-37ad9efb7c6e tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 200 len: 1656 microversion: 2.20 time: 0.100924 Jun 17 11:48:49.599838 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 460/924] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:48:49 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 1656 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 11:48:50.216487 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-36659aa9-35c0-41e9-b505-c0b116eb1d7b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:50.218084 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-36659aa9-35c0-41e9-b505-c0b116eb1d7b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:50.231272 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-36659aa9-35c0-41e9-b505-c0b116eb1d7b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:50.232154 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-36659aa9-35c0-41e9-b505-c0b116eb1d7b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:50.247421 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-36659aa9-35c0-41e9-b505-c0b116eb1d7b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:50.249055 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-36659aa9-35c0-41e9-b505-c0b116eb1d7b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:50.526043 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-36659aa9-35c0-41e9-b505-c0b116eb1d7b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:50.537286 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-36659aa9-35c0-41e9-b505-c0b116eb1d7b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1566 microversion: 2.1 time: 0.326597 Jun 17 11:48:50.538637 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 465/925] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:50 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1566 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:48:50.620063 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-183aad43-87f2-4ddd-a3a6-3d2daf07cfa2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:50.622048 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-183aad43-87f2-4ddd-a3a6-3d2daf07cfa2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:50.629688 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-183aad43-87f2-4ddd-a3a6-3d2daf07cfa2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:50.630523 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-183aad43-87f2-4ddd-a3a6-3d2daf07cfa2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:50.631326 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-183aad43-87f2-4ddd-a3a6-3d2daf07cfa2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:50.631804 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-183aad43-87f2-4ddd-a3a6-3d2daf07cfa2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:50.648507 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-183aad43-87f2-4ddd-a3a6-3d2daf07cfa2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] HTTP exception thrown: Instance f4eb9c8c-b733-475e-b69e-279e9295ac4d could not be found. Jun 17 11:48:50.650091 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-183aad43-87f2-4ddd-a3a6-3d2daf07cfa2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Request method failure captured: Jun 17 11:48:50.650091 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: request: GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d HTTP/1.1 Jun 17 11:48:50.650091 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept: application/json Jun 17 11:48:50.650091 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jun 17 11:48:50.650091 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Connection: close Jun 17 11:48:50.650091 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jun 17 11:48:50.650091 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jun 17 11:48:50.650091 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Host: 10.222.0.45 Jun 17 11:48:50.650091 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jun 17 11:48:50.650091 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jun 17 11:48:50.650091 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABirGhbyTP6m8A6ocgcmCTbD2vtB5wliIaOyA8S7K2P96o-JRntRfJUSSZ-WD1QB-eTMm9Rz6lGJCOx-RLb0Rcq3CsQFid38C6tit0d8QF69DexK2qxFSYg5BUKaBJV8YlN8x7PJ8SeLm0KommhoQlq6Zz2O8A6Hy2IuR2pqoxEMVsxlg0 Jun 17 11:48:50.650091 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jun 17 11:48:50.650091 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jun 17 11:48:50.650091 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jun 17 11:48:50.650091 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jun 17 11:48:50.650091 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 11:48:50.650091 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jun 17 11:48:50.650091 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jun 17 11:48:50.650091 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Id: bc8dc1335e284eee8cca45d5720d5f16 Jun 17 11:48:50.650091 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1476822038 Jun 17 11:48:50.650091 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Role: member,reader Jun 17 11:48:50.650091 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Roles: member,reader Jun 17 11:48:50.652237 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bc8dc1335e284eee8cca45d5720d5f16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bc8dc1335e284eee8cca45d5720d5f16", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bc8dc1335e284eee8cca45d5720d5f16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bc8dc1335e284eee8cca45d5720d5f16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:48:50.652237 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1476822038 Jun 17 11:48:50.652237 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Id: bc8dc1335e284eee8cca45d5720d5f16 Jun 17 11:48:50.652237 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1476822038 Jun 17 11:48:50.652237 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User: tempest-AttachVolumeShelveTestJSON-1476822038-project Jun 17 11:48:50.652237 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jun 17 11:48:50.652237 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jun 17 11:48:50.652237 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Id: d817bad669fc4d6f829bf6eb57773b23 Jun 17 11:48:50.652237 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1476822038-project Jun 17 11:48:50.652237 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: method: > Jun 17 11:48:50.652237 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: exception: Instance f4eb9c8c-b733-475e-b69e-279e9295ac4d could not be found. Jun 17 11:48:50.652237 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: action_args: {'id': 'f4eb9c8c-b733-475e-b69e-279e9295ac4d'} Jun 17 11:48:50.654084 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:48:50.654084 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:50.654084 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:48:50.654084 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:48:50.654084 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:48:50.654084 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:48:50.654084 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:48:50.654084 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:48:50.654084 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:48:50.654084 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:48:50.654084 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4eb9c8c-b733-475e-b69e-279e9295ac4d could not be found. Jun 17 11:48:50.654084 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:50.654084 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:50.654084 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:50.654084 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:50.654084 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:50.654084 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:50.654084 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:48:50.654084 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:48:50.654084 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:48:50.665748 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:48:50.665748 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 11:48:50.665748 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 11:48:50.665748 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:48:50.665748 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:48:50.665748 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:48:50.665748 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:48:50.665748 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4eb9c8c-b733-475e-b69e-279e9295ac4d could not be found. Jun 17 11:48:50.665748 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:50.665748 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:50.665748 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:50.665748 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:50.665748 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:50.665748 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:50.665748 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:48:50.665748 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:48:50.665748 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4eb9c8c-b733-475e-b69e-279e9295ac4d could not be found. Jun 17 11:48:50.665748 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:50.666914 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-183aad43-87f2-4ddd-a3a6-3d2daf07cfa2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Returning 404 to user: Instance f4eb9c8c-b733-475e-b69e-279e9295ac4d could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:48:50.666914 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-183aad43-87f2-4ddd-a3a6-3d2daf07cfa2 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 404 len: 111 microversion: 2.20 time: 0.036208 Jun 17 11:48:50.666914 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 461/926] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:48:50 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 11:48:50.667134 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a67115ed-aaa8-4ca9-a512-adf4a5e610d7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '.version_select at 0x7f9c7b11a430>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:50.799457 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a67115ed-aaa8-4ca9-a512-adf4a5e610d7 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1606076017" status: 204 len: 0 microversion: 2.20 time: 0.142380 Jun 17 11:48:50.800069 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 466/927] 10.222.0.45 () {60 vars in 1261 bytes} [Fri Jun 17 11:48:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1606076017 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 17 11:48:51.554906 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e1da6d12-4e9b-4276-9cda-a69a5f9d7c7b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:51.555736 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e1da6d12-4e9b-4276-9cda-a69a5f9d7c7b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:51.562326 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e1da6d12-4e9b-4276-9cda-a69a5f9d7c7b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:51.562930 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e1da6d12-4e9b-4276-9cda-a69a5f9d7c7b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:51.563882 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e1da6d12-4e9b-4276-9cda-a69a5f9d7c7b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:51.564420 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e1da6d12-4e9b-4276-9cda-a69a5f9d7c7b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:51.755627 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e1da6d12-4e9b-4276-9cda-a69a5f9d7c7b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:51.769276 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e1da6d12-4e9b-4276-9cda-a69a5f9d7c7b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1566 microversion: 2.1 time: 0.218344 Jun 17 11:48:51.770561 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 462/928] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:51 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1566 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:48:52.796449 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0c4cce99-5036-4f0c-b3bd-64ee674f1754 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:52.797064 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0c4cce99-5036-4f0c-b3bd-64ee674f1754 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:52.803527 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0c4cce99-5036-4f0c-b3bd-64ee674f1754 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:52.805177 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0c4cce99-5036-4f0c-b3bd-64ee674f1754 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:52.805956 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0c4cce99-5036-4f0c-b3bd-64ee674f1754 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:52.806421 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0c4cce99-5036-4f0c-b3bd-64ee674f1754 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:52.958669 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0c4cce99-5036-4f0c-b3bd-64ee674f1754 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:52.962762 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0c4cce99-5036-4f0c-b3bd-64ee674f1754 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1566 microversion: 2.1 time: 0.171321 Jun 17 11:48:52.963336 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 467/929] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:52 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:48:53.358513 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2ec7cec7-8aaf-4d6d-9081-2b18694677ad tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:53.359068 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-2ec7cec7-8aaf-4d6d-9081-2b18694677ad tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:53.365796 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2ec7cec7-8aaf-4d6d-9081-2b18694677ad tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:53.367882 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2ec7cec7-8aaf-4d6d-9081-2b18694677ad tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:53.367882 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2ec7cec7-8aaf-4d6d-9081-2b18694677ad tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:53.368261 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2ec7cec7-8aaf-4d6d-9081-2b18694677ad tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:53.383510 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-2ec7cec7-8aaf-4d6d-9081-2b18694677ad tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] HTTP exception thrown: Instance f4eb9c8c-b733-475e-b69e-279e9295ac4d could not be found. Jun 17 11:48:53.385120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2ec7cec7-8aaf-4d6d-9081-2b18694677ad tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Request method failure captured: Jun 17 11:48:53.385120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: request: DELETE /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d HTTP/1.1 Jun 17 11:48:53.385120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept: application/json Jun 17 11:48:53.385120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jun 17 11:48:53.385120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Connection: close Jun 17 11:48:53.385120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jun 17 11:48:53.385120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jun 17 11:48:53.385120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Host: 10.222.0.45 Jun 17 11:48:53.385120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jun 17 11:48:53.385120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jun 17 11:48:53.385120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABirGhbyTP6m8A6ocgcmCTbD2vtB5wliIaOyA8S7K2P96o-JRntRfJUSSZ-WD1QB-eTMm9Rz6lGJCOx-RLb0Rcq3CsQFid38C6tit0d8QF69DexK2qxFSYg5BUKaBJV8YlN8x7PJ8SeLm0KommhoQlq6Zz2O8A6Hy2IuR2pqoxEMVsxlg0 Jun 17 11:48:53.385120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jun 17 11:48:53.385120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jun 17 11:48:53.385120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jun 17 11:48:53.385120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jun 17 11:48:53.385120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 11:48:53.385120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jun 17 11:48:53.385120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jun 17 11:48:53.385120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Id: bc8dc1335e284eee8cca45d5720d5f16 Jun 17 11:48:53.385120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1476822038 Jun 17 11:48:53.385120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Role: member,reader Jun 17 11:48:53.385120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Roles: member,reader Jun 17 11:48:53.386652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bc8dc1335e284eee8cca45d5720d5f16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bc8dc1335e284eee8cca45d5720d5f16", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bc8dc1335e284eee8cca45d5720d5f16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bc8dc1335e284eee8cca45d5720d5f16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:48:53.386652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1476822038 Jun 17 11:48:53.386652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Id: bc8dc1335e284eee8cca45d5720d5f16 Jun 17 11:48:53.386652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1476822038 Jun 17 11:48:53.386652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User: tempest-AttachVolumeShelveTestJSON-1476822038-project Jun 17 11:48:53.386652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jun 17 11:48:53.386652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jun 17 11:48:53.386652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Id: d817bad669fc4d6f829bf6eb57773b23 Jun 17 11:48:53.386652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1476822038-project Jun 17 11:48:53.386652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: method: > Jun 17 11:48:53.386652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: exception: Instance f4eb9c8c-b733-475e-b69e-279e9295ac4d could not be found. Jun 17 11:48:53.386652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: action_args: {'id': 'f4eb9c8c-b733-475e-b69e-279e9295ac4d'} Jun 17 11:48:53.387384 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:48:53.387384 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:53.387384 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:48:53.387384 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:48:53.387384 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:48:53.387384 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:48:53.387384 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:48:53.387384 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:48:53.387384 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:48:53.387384 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:48:53.387384 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4eb9c8c-b733-475e-b69e-279e9295ac4d could not be found. Jun 17 11:48:53.387384 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:53.387384 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:53.387384 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:53.387384 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:53.387384 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:53.387384 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:53.387384 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:48:53.387384 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:48:53.387384 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:48:53.388792 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:48:53.388792 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 11:48:53.388792 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 11:48:53.388792 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 11:48:53.388792 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 11:48:53.388792 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:48:53.388792 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:48:53.388792 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:48:53.388792 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:48:53.388792 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4eb9c8c-b733-475e-b69e-279e9295ac4d could not be found. Jun 17 11:48:53.388792 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:53.388792 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:53.388792 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:53.388792 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:53.388792 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:53.388792 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:53.388792 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:48:53.388792 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:48:53.388792 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4eb9c8c-b733-475e-b69e-279e9295ac4d could not be found. Jun 17 11:48:53.388792 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:53.390261 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2ec7cec7-8aaf-4d6d-9081-2b18694677ad tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Returning 404 to user: Instance f4eb9c8c-b733-475e-b69e-279e9295ac4d could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:48:53.390261 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2ec7cec7-8aaf-4d6d-9081-2b18694677ad tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 404 len: 111 microversion: 2.20 time: 0.032346 Jun 17 11:48:53.390261 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 463/930] 10.222.0.45 () {60 vars in 1279 bytes} [Fri Jun 17 11:48:53 2022] DELETE /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 11:48:53.396721 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4d341883-6f42-4136-9a83-420480bc9e88 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:53.397337 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4d341883-6f42-4136-9a83-420480bc9e88 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: f4eb9c8c-b733-475e-b69e-279e9295ac4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:53.405973 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4d341883-6f42-4136-9a83-420480bc9e88 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:53.406421 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4d341883-6f42-4136-9a83-420480bc9e88 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:53.407659 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4d341883-6f42-4136-9a83-420480bc9e88 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:53.407923 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4d341883-6f42-4136-9a83-420480bc9e88 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:53.423648 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-4d341883-6f42-4136-9a83-420480bc9e88 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] HTTP exception thrown: Instance f4eb9c8c-b733-475e-b69e-279e9295ac4d could not be found. Jun 17 11:48:53.425514 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4d341883-6f42-4136-9a83-420480bc9e88 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Request method failure captured: Jun 17 11:48:53.425514 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d HTTP/1.1 Jun 17 11:48:53.425514 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jun 17 11:48:53.425514 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jun 17 11:48:53.425514 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Connection: close Jun 17 11:48:53.425514 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jun 17 11:48:53.425514 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jun 17 11:48:53.425514 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.45 Jun 17 11:48:53.425514 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jun 17 11:48:53.425514 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jun 17 11:48:53.425514 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABirGhbyTP6m8A6ocgcmCTbD2vtB5wliIaOyA8S7K2P96o-JRntRfJUSSZ-WD1QB-eTMm9Rz6lGJCOx-RLb0Rcq3CsQFid38C6tit0d8QF69DexK2qxFSYg5BUKaBJV8YlN8x7PJ8SeLm0KommhoQlq6Zz2O8A6Hy2IuR2pqoxEMVsxlg0 Jun 17 11:48:53.425514 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jun 17 11:48:53.425514 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jun 17 11:48:53.425514 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jun 17 11:48:53.425514 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jun 17 11:48:53.425514 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 11:48:53.425514 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jun 17 11:48:53.425514 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jun 17 11:48:53.425514 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Id: bc8dc1335e284eee8cca45d5720d5f16 Jun 17 11:48:53.425514 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1476822038 Jun 17 11:48:53.425514 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jun 17 11:48:53.425514 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jun 17 11:48:53.427490 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bc8dc1335e284eee8cca45d5720d5f16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bc8dc1335e284eee8cca45d5720d5f16", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bc8dc1335e284eee8cca45d5720d5f16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bc8dc1335e284eee8cca45d5720d5f16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:48:53.427490 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1476822038 Jun 17 11:48:53.427490 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: bc8dc1335e284eee8cca45d5720d5f16 Jun 17 11:48:53.427490 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1476822038 Jun 17 11:48:53.427490 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User: tempest-AttachVolumeShelveTestJSON-1476822038-project Jun 17 11:48:53.427490 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jun 17 11:48:53.427490 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jun 17 11:48:53.427490 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Id: d817bad669fc4d6f829bf6eb57773b23 Jun 17 11:48:53.427490 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1476822038-project Jun 17 11:48:53.427490 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: method: > Jun 17 11:48:53.427490 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: exception: Instance f4eb9c8c-b733-475e-b69e-279e9295ac4d could not be found. Jun 17 11:48:53.427490 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: action_args: {'id': 'f4eb9c8c-b733-475e-b69e-279e9295ac4d'} Jun 17 11:48:53.428244 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:48:53.428244 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:53.428244 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:48:53.428244 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:48:53.428244 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:48:53.428244 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:48:53.428244 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:48:53.428244 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:48:53.428244 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:48:53.428244 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:48:53.428244 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4eb9c8c-b733-475e-b69e-279e9295ac4d could not be found. Jun 17 11:48:53.428244 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:53.428244 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:53.428244 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:53.428244 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:53.428244 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:53.428244 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:53.428244 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:48:53.428244 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:48:53.428244 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:48:53.438326 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:48:53.438326 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 11:48:53.438326 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 11:48:53.438326 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:48:53.438326 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:48:53.438326 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:48:53.438326 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:48:53.438326 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4eb9c8c-b733-475e-b69e-279e9295ac4d could not be found. Jun 17 11:48:53.438326 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:53.438326 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:53.438326 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:53.438326 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:53.438326 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:53.438326 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:53.438326 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:48:53.438326 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:48:53.438326 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4eb9c8c-b733-475e-b69e-279e9295ac4d could not be found. Jun 17 11:48:53.438326 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:53.440395 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4d341883-6f42-4136-9a83-420480bc9e88 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Returning 404 to user: Instance f4eb9c8c-b733-475e-b69e-279e9295ac4d could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:48:53.440395 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4d341883-6f42-4136-9a83-420480bc9e88 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d" status: 404 len: 111 microversion: 2.20 time: 0.034729 Jun 17 11:48:53.440395 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 468/931] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:48:53 2022] GET /compute/v2.1/servers/f4eb9c8c-b733-475e-b69e-279e9295ac4d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 11:48:53.980072 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b50ec13c-94ac-4300-8781-00faaf141ab3 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:53.980720 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b50ec13c-94ac-4300-8781-00faaf141ab3 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:53.988039 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b50ec13c-94ac-4300-8781-00faaf141ab3 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:53.988510 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b50ec13c-94ac-4300-8781-00faaf141ab3 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:53.989290 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b50ec13c-94ac-4300-8781-00faaf141ab3 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:53.989724 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b50ec13c-94ac-4300-8781-00faaf141ab3 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:54.098163 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-46b06492-b4e2-4220-a1f1-c180b2db6949 tempest-VolumesNegativeTest-1485743726 tempest-VolumesNegativeTest-1485743726-project] Action: 'create', calling method: .version_select at 0x7f9c767311f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-124190573", "metadata": {"Type": "work"}}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:48:54.118604 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-46b06492-b4e2-4220-a1f1-c180b2db6949 tempest-VolumesNegativeTest-1485743726 tempest-VolumesNegativeTest-1485743726-project] Request method failure captured: Jun 17 11:48:54.118604 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 17 11:48:54.118604 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept: application/json Jun 17 11:48:54.118604 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jun 17 11:48:54.118604 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Connection: close Jun 17 11:48:54.118604 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Length: 121 Jun 17 11:48:54.118604 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jun 17 11:48:54.118604 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Host: 10.222.0.45 Jun 17 11:48:54.118604 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jun 17 11:48:54.118604 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jun 17 11:48:54.118604 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABirGolizFguPQknWWh1E99ipB0r-KFTUxYmSWIIIA3w1MkHZZLDZdtG8CpXs_NYBRS1WSJVo-GtgdOPZVd7R30jqQUvxrio7tuTy899-E7N_zLhg_uclO5jUhBc5h3uAEm3XvZRLuBniPvh2XbTu6W9RA6td_QepUrAm7mHuqezzY_9lE Jun 17 11:48:54.118604 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jun 17 11:48:54.118604 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jun 17 11:48:54.118604 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jun 17 11:48:54.118604 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jun 17 11:48:54.118604 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jun 17 11:48:54.118604 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jun 17 11:48:54.118604 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Id: 3a1f2372d9644a8a9ec0cbde578ab2d0 Jun 17 11:48:54.118604 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-VolumesNegativeTest-1485743726 Jun 17 11:48:54.118604 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Role: member,reader Jun 17 11:48:54.118604 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Roles: member,reader Jun 17 11:48:54.121823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3a1f2372d9644a8a9ec0cbde578ab2d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3a1f2372d9644a8a9ec0cbde578ab2d0", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3a1f2372d9644a8a9ec0cbde578ab2d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3a1f2372d9644a8a9ec0cbde578ab2d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:48:54.121823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-VolumesNegativeTest-1485743726 Jun 17 11:48:54.121823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Id: 3a1f2372d9644a8a9ec0cbde578ab2d0 Jun 17 11:48:54.121823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-VolumesNegativeTest-1485743726 Jun 17 11:48:54.121823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User: tempest-VolumesNegativeTest-1485743726-project Jun 17 11:48:54.121823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jun 17 11:48:54.121823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jun 17 11:48:54.121823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Id: 5f491879e9ca41fc932f9d5b0b5de24a Jun 17 11:48:54.121823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-VolumesNegativeTest-1485743726-project Jun 17 11:48:54.121823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Jun 17 11:48:54.121823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-124190573", "metadata": {"Type": "work"}}} Jun 17 11:48:54.121823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: method: Jun 17 11:48:54.121823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 17 11:48:54.122652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-124190573', 'metadata': {'Type': 'work'}}}} Jun 17 11:48:54.122652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:48:54.122652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:54.122652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 17 11:48:54.122652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 17 11:48:54.122652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 17 11:48:54.122652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise error Jun 17 11:48:54.122652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 17 11:48:54.122652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.122652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 17 11:48:54.122652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 17 11:48:54.122652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.122652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 17 11:48:54.122652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi '#$%' Jun 17 11:48:54.122652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.122652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:54.122652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.122652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:54.122652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:54.122652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:54.122652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:48:54.122652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:48:54.124759 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 11:48:54.124759 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 11:48:54.124759 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:48:54.124759 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:48:54.124759 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 17 11:48:54.124759 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 17 11:48:54.124759 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 17 11:48:54.124759 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 17 11:48:54.124759 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 17 11:48:54.124759 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 17 11:48:54.124759 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 17 11:48:54.124759 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.124759 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:54.124759 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.124759 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:54.124759 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:54.124759 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:54.124759 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 17 11:48:54.124759 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 17 11:48:54.127561 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 17 11:48:54.127561 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.127561 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-46b06492-b4e2-4220-a1f1-c180b2db6949 tempest-VolumesNegativeTest-1485743726 tempest-VolumesNegativeTest-1485743726-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:48:54.127561 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-46b06492-b4e2-4220-a1f1-c180b2db6949 tempest-VolumesNegativeTest-1485743726 tempest-VolumesNegativeTest-1485743726-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.151054 Jun 17 11:48:54.127561 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 464/932] 10.222.0.45 () {60 vars in 1155 bytes} [Fri Jun 17 11:48:53 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 153 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 11:48:54.139233 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b50ec13c-94ac-4300-8781-00faaf141ab3 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:54.139526 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8e0a4dcb-5882-4722-abe6-1c5e5a203c33 tempest-VolumesNegativeTest-1485743726 tempest-VolumesNegativeTest-1485743726-project] Action: 'create', calling method: .version_select at 0x7f9c766eb1f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2024954731", "metadata": {"Type": "work"}}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:48:54.142823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8e0a4dcb-5882-4722-abe6-1c5e5a203c33 tempest-VolumesNegativeTest-1485743726 tempest-VolumesNegativeTest-1485743726-project] Request method failure captured: Jun 17 11:48:54.142823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 17 11:48:54.142823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept: application/json Jun 17 11:48:54.142823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jun 17 11:48:54.142823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Connection: close Jun 17 11:48:54.142823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Length: 120 Jun 17 11:48:54.142823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jun 17 11:48:54.142823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Host: 10.222.0.45 Jun 17 11:48:54.142823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jun 17 11:48:54.142823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jun 17 11:48:54.142823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABirGolizFguPQknWWh1E99ipB0r-KFTUxYmSWIIIA3w1MkHZZLDZdtG8CpXs_NYBRS1WSJVo-GtgdOPZVd7R30jqQUvxrio7tuTy899-E7N_zLhg_uclO5jUhBc5h3uAEm3XvZRLuBniPvh2XbTu6W9RA6td_QepUrAm7mHuqezzY_9lE Jun 17 11:48:54.142823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jun 17 11:48:54.142823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jun 17 11:48:54.142823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jun 17 11:48:54.142823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jun 17 11:48:54.142823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jun 17 11:48:54.142823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jun 17 11:48:54.142823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Id: 3a1f2372d9644a8a9ec0cbde578ab2d0 Jun 17 11:48:54.142823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-VolumesNegativeTest-1485743726 Jun 17 11:48:54.142823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Role: member,reader Jun 17 11:48:54.142823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Roles: member,reader Jun 17 11:48:54.144337 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3a1f2372d9644a8a9ec0cbde578ab2d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3a1f2372d9644a8a9ec0cbde578ab2d0", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3a1f2372d9644a8a9ec0cbde578ab2d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3a1f2372d9644a8a9ec0cbde578ab2d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:48:54.144337 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-VolumesNegativeTest-1485743726 Jun 17 11:48:54.144337 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Id: 3a1f2372d9644a8a9ec0cbde578ab2d0 Jun 17 11:48:54.144337 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-VolumesNegativeTest-1485743726 Jun 17 11:48:54.144337 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User: tempest-VolumesNegativeTest-1485743726-project Jun 17 11:48:54.144337 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jun 17 11:48:54.144337 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jun 17 11:48:54.144337 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Id: 5f491879e9ca41fc932f9d5b0b5de24a Jun 17 11:48:54.144337 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-VolumesNegativeTest-1485743726-project Jun 17 11:48:54.144337 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Jun 17 11:48:54.144337 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2024954731", "metadata": {"Type": "work"}}} Jun 17 11:48:54.144337 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: method: Jun 17 11:48:54.144337 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 17 11:48:54.145173 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2024954731', 'metadata': {'Type': 'work'}}}} Jun 17 11:48:54.145173 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:48:54.145173 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:54.145173 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 17 11:48:54.145173 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 17 11:48:54.145173 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 17 11:48:54.145173 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise error Jun 17 11:48:54.145173 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 17 11:48:54.145173 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.145173 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 17 11:48:54.145173 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 17 11:48:54.145173 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.145173 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 17 11:48:54.145173 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi '0' Jun 17 11:48:54.145173 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.145173 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:54.145173 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.145173 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:54.145173 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:54.145173 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:54.145173 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:48:54.145173 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:48:54.146959 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 11:48:54.146959 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 11:48:54.146959 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:48:54.146959 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:48:54.146959 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 17 11:48:54.146959 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 17 11:48:54.146959 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 17 11:48:54.146959 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 17 11:48:54.146959 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 17 11:48:54.146959 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 17 11:48:54.146959 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 17 11:48:54.146959 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.146959 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:54.146959 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.146959 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:54.146959 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:54.146959 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:54.146959 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 17 11:48:54.146959 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 17 11:48:54.148905 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 17 11:48:54.148905 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.148905 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8e0a4dcb-5882-4722-abe6-1c5e5a203c33 tempest-VolumesNegativeTest-1485743726 tempest-VolumesNegativeTest-1485743726-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:48:54.148905 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-8e0a4dcb-5882-4722-abe6-1c5e5a203c33 tempest-VolumesNegativeTest-1485743726 tempest-VolumesNegativeTest-1485743726-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012857 Jun 17 11:48:54.148905 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 465/933] 10.222.0.45 () {60 vars in 1155 bytes} [Fri Jun 17 11:48:54 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 17 11:48:54.149661 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b50ec13c-94ac-4300-8781-00faaf141ab3 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1566 microversion: 2.1 time: 0.171987 Jun 17 11:48:54.149661 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 469/934] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:53 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:48:54.156784 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6e15ec51-6255-4f97-a242-7c18ee10aca5 tempest-VolumesNegativeTest-1485743726 tempest-VolumesNegativeTest-1485743726-project] Action: 'create', calling method: .version_select at 0x7f9c76731f70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-408810364", "metadata": {"Type": "work"}}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:48:54.160323 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6e15ec51-6255-4f97-a242-7c18ee10aca5 tempest-VolumesNegativeTest-1485743726 tempest-VolumesNegativeTest-1485743726-project] Request method failure captured: Jun 17 11:48:54.160323 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 17 11:48:54.160323 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept: application/json Jun 17 11:48:54.160323 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jun 17 11:48:54.160323 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Connection: close Jun 17 11:48:54.160323 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Length: 118 Jun 17 11:48:54.160323 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jun 17 11:48:54.160323 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Host: 10.222.0.45 Jun 17 11:48:54.160323 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jun 17 11:48:54.160323 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jun 17 11:48:54.160323 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABirGolizFguPQknWWh1E99ipB0r-KFTUxYmSWIIIA3w1MkHZZLDZdtG8CpXs_NYBRS1WSJVo-GtgdOPZVd7R30jqQUvxrio7tuTy899-E7N_zLhg_uclO5jUhBc5h3uAEm3XvZRLuBniPvh2XbTu6W9RA6td_QepUrAm7mHuqezzY_9lE Jun 17 11:48:54.160323 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jun 17 11:48:54.160323 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jun 17 11:48:54.160323 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jun 17 11:48:54.160323 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jun 17 11:48:54.160323 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jun 17 11:48:54.160323 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jun 17 11:48:54.160323 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Id: 3a1f2372d9644a8a9ec0cbde578ab2d0 Jun 17 11:48:54.160323 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-VolumesNegativeTest-1485743726 Jun 17 11:48:54.160323 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Role: member,reader Jun 17 11:48:54.160323 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Roles: member,reader Jun 17 11:48:54.162020 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3a1f2372d9644a8a9ec0cbde578ab2d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3a1f2372d9644a8a9ec0cbde578ab2d0", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3a1f2372d9644a8a9ec0cbde578ab2d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3a1f2372d9644a8a9ec0cbde578ab2d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:48:54.162020 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-VolumesNegativeTest-1485743726 Jun 17 11:48:54.162020 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Id: 3a1f2372d9644a8a9ec0cbde578ab2d0 Jun 17 11:48:54.162020 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-VolumesNegativeTest-1485743726 Jun 17 11:48:54.162020 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User: tempest-VolumesNegativeTest-1485743726-project Jun 17 11:48:54.162020 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jun 17 11:48:54.162020 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jun 17 11:48:54.162020 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Id: 5f491879e9ca41fc932f9d5b0b5de24a Jun 17 11:48:54.162020 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-VolumesNegativeTest-1485743726-project Jun 17 11:48:54.162020 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Jun 17 11:48:54.162020 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-408810364", "metadata": {"Type": "work"}}} Jun 17 11:48:54.162020 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: method: Jun 17 11:48:54.162020 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 17 11:48:54.163039 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-408810364', 'metadata': {'Type': 'work'}}}} Jun 17 11:48:54.163039 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:48:54.163039 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:54.163039 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 17 11:48:54.163039 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 17 11:48:54.163039 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 17 11:48:54.163039 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise error Jun 17 11:48:54.163039 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 17 11:48:54.163039 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.163039 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 17 11:48:54.163039 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 17 11:48:54.163039 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.163039 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 17 11:48:54.163039 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi '' Jun 17 11:48:54.163039 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.163039 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:54.163039 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.163039 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:54.163039 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:54.163039 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:54.163039 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:48:54.163039 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:48:54.165504 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 11:48:54.165504 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 11:48:54.165504 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:48:54.165504 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:48:54.165504 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 17 11:48:54.165504 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 17 11:48:54.165504 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 17 11:48:54.165504 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 17 11:48:54.165504 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 17 11:48:54.165504 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 17 11:48:54.165504 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 17 11:48:54.165504 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.165504 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:54.165504 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.165504 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:54.165504 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:54.165504 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:54.165504 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 17 11:48:54.165504 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 17 11:48:54.166886 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 17 11:48:54.166886 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.166886 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6e15ec51-6255-4f97-a242-7c18ee10aca5 tempest-VolumesNegativeTest-1485743726 tempest-VolumesNegativeTest-1485743726-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:48:54.166886 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-6e15ec51-6255-4f97-a242-7c18ee10aca5 tempest-VolumesNegativeTest-1485743726 tempest-VolumesNegativeTest-1485743726-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008064 Jun 17 11:48:54.166886 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 466/935] 10.222.0.45 () {60 vars in 1155 bytes} [Fri Jun 17 11:48:54 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 17 11:48:54.170342 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b3a271f2-14c7-42d3-937e-97dfbe20bf17 tempest-VolumesNegativeTest-1485743726 tempest-VolumesNegativeTest-1485743726-project] Calling method '.version_select at 0x7f9c76cdf5e0>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:54.202957 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-b3a271f2-14c7-42d3-937e-97dfbe20bf17 tempest-VolumesNegativeTest-1485743726 tempest-VolumesNegativeTest-1485743726-project] HTTP exception thrown: Volume tempest-invalid-797177168 could not be found. Jun 17 11:48:54.204412 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b3a271f2-14c7-42d3-937e-97dfbe20bf17 tempest-VolumesNegativeTest-1485743726 tempest-VolumesNegativeTest-1485743726-project] Request method failure captured: Jun 17 11:48:54.204412 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-797177168 HTTP/1.1 Jun 17 11:48:54.204412 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jun 17 11:48:54.204412 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jun 17 11:48:54.204412 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Connection: close Jun 17 11:48:54.204412 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jun 17 11:48:54.204412 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jun 17 11:48:54.204412 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.45 Jun 17 11:48:54.204412 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jun 17 11:48:54.204412 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jun 17 11:48:54.204412 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABirGolizFguPQknWWh1E99ipB0r-KFTUxYmSWIIIA3w1MkHZZLDZdtG8CpXs_NYBRS1WSJVo-GtgdOPZVd7R30jqQUvxrio7tuTy899-E7N_zLhg_uclO5jUhBc5h3uAEm3XvZRLuBniPvh2XbTu6W9RA6td_QepUrAm7mHuqezzY_9lE Jun 17 11:48:54.204412 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jun 17 11:48:54.204412 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jun 17 11:48:54.204412 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jun 17 11:48:54.204412 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jun 17 11:48:54.204412 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jun 17 11:48:54.204412 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jun 17 11:48:54.204412 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Id: 3a1f2372d9644a8a9ec0cbde578ab2d0 Jun 17 11:48:54.204412 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-VolumesNegativeTest-1485743726 Jun 17 11:48:54.204412 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jun 17 11:48:54.204412 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jun 17 11:48:54.205967 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3a1f2372d9644a8a9ec0cbde578ab2d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3a1f2372d9644a8a9ec0cbde578ab2d0", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3a1f2372d9644a8a9ec0cbde578ab2d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3a1f2372d9644a8a9ec0cbde578ab2d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:48:54.205967 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-VolumesNegativeTest-1485743726 Jun 17 11:48:54.205967 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: 3a1f2372d9644a8a9ec0cbde578ab2d0 Jun 17 11:48:54.205967 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-VolumesNegativeTest-1485743726 Jun 17 11:48:54.205967 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User: tempest-VolumesNegativeTest-1485743726-project Jun 17 11:48:54.205967 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jun 17 11:48:54.205967 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jun 17 11:48:54.205967 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Id: 5f491879e9ca41fc932f9d5b0b5de24a Jun 17 11:48:54.205967 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-VolumesNegativeTest-1485743726-project Jun 17 11:48:54.205967 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: method: Jun 17 11:48:54.205967 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: exception: Volume tempest-invalid-797177168 could not be found. Jun 17 11:48:54.205967 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: action_args: {'id': 'tempest-invalid-797177168'} Jun 17 11:48:54.205967 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:48:54.206781 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:54.206781 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 11:48:54.206781 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 11:48:54.206781 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 11:48:54.206781 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 11:48:54.206781 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 11:48:54.206781 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 11:48:54.206781 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 11:48:54.206781 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 11:48:54.206781 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 11:48:54.206781 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 11:48:54.206781 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 11:48:54.206781 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 11:48:54.206781 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 11:48:54.206781 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 11:48:54.206781 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-797177168 could not be found. (HTTP 404) (Request-ID: req-8862c48d-1e0c-4eb4-9e42-3692ab75deb8) Jun 17 11:48:54.206781 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.206781 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:54.206781 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.207994 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:54.207994 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 17 11:48:54.207994 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 17 11:48:54.207994 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 11:48:54.207994 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 11:48:54.207994 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 11:48:54.207994 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 11:48:54.207994 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 11:48:54.207994 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 11:48:54.207994 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 11:48:54.207994 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 11:48:54.207994 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 11:48:54.207994 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 11:48:54.207994 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 11:48:54.207994 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 11:48:54.207994 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 11:48:54.207994 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 11:48:54.207994 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 11:48:54.207994 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 11:48:54.209180 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 11:48:54.209180 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 11:48:54.209180 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 11:48:54.209180 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 11:48:54.209180 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-797177168 could not be found. Jun 17 11:48:54.209180 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.209180 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:54.209180 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.209180 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:54.209180 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:54.209180 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:54.209180 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:48:54.209180 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:48:54.209180 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 11:48:54.209180 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 11:48:54.209180 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:48:54.209180 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:48:54.209180 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 17 11:48:54.209180 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:48:54.209180 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-797177168 could not be found. Jun 17 11:48:54.210990 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.210990 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:54.210990 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.210990 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:54.210990 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:54.210990 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:54.210990 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:48:54.210990 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:48:54.210990 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-797177168 could not be found. Jun 17 11:48:54.210990 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.210990 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b3a271f2-14c7-42d3-937e-97dfbe20bf17 tempest-VolumesNegativeTest-1485743726 tempest-VolumesNegativeTest-1485743726-project] Returning 404 to user: Volume tempest-invalid-797177168 could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:48:54.210990 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b3a271f2-14c7-42d3-937e-97dfbe20bf17 tempest-VolumesNegativeTest-1485743726 tempest-VolumesNegativeTest-1485743726-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/tempest-invalid-797177168" status: 404 len: 98 microversion: 2.1 time: 0.039564 Jun 17 11:48:54.210990 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 470/936] 10.222.0.45 () {58 vars in 1214 bytes} [Fri Jun 17 11:48:54 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-797177168 => generated 98 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 17 11:48:54.217860 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d682b54d-88f2-4619-80ea-126e1871bbdd tempest-VolumesNegativeTest-1485743726 tempest-VolumesNegativeTest-1485743726-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003968 Jun 17 11:48:54.218398 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 467/937] 10.222.0.45 () {58 vars in 1139 bytes} [Fri Jun 17 11:48:54 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 17 11:48:54.227765 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-7a03d210-71f4-4ca6-9542-e05329f3b491 tempest-VolumesNegativeTest-1485743726 tempest-VolumesNegativeTest-1485743726-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003989 Jun 17 11:48:54.228271 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 471/938] 10.222.0.45 () {58 vars in 1136 bytes} [Fri Jun 17 11:48:54 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 17 11:48:54.237683 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c42efcaa-ed92-4e9c-b55b-111262abd4aa tempest-VolumesNegativeTest-1485743726 tempest-VolumesNegativeTest-1485743726-project] Calling method '.version_select at 0x7f9c767194c0>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:54.268956 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-c42efcaa-ed92-4e9c-b55b-111262abd4aa tempest-VolumesNegativeTest-1485743726 tempest-VolumesNegativeTest-1485743726-project] HTTP exception thrown: Volume 1749feca-e96d-4d03-96ad-3458d1244e18 could not be found. Jun 17 11:48:54.270925 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c42efcaa-ed92-4e9c-b55b-111262abd4aa tempest-VolumesNegativeTest-1485743726 tempest-VolumesNegativeTest-1485743726-project] Request method failure captured: Jun 17 11:48:54.270925 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: request: DELETE /compute/v2.1/os-volumes/1749feca-e96d-4d03-96ad-3458d1244e18 HTTP/1.1 Jun 17 11:48:54.270925 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept: application/json Jun 17 11:48:54.270925 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jun 17 11:48:54.270925 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Connection: close Jun 17 11:48:54.270925 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jun 17 11:48:54.270925 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jun 17 11:48:54.270925 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Host: 10.222.0.45 Jun 17 11:48:54.270925 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jun 17 11:48:54.270925 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jun 17 11:48:54.270925 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABirGolizFguPQknWWh1E99ipB0r-KFTUxYmSWIIIA3w1MkHZZLDZdtG8CpXs_NYBRS1WSJVo-GtgdOPZVd7R30jqQUvxrio7tuTy899-E7N_zLhg_uclO5jUhBc5h3uAEm3XvZRLuBniPvh2XbTu6W9RA6td_QepUrAm7mHuqezzY_9lE Jun 17 11:48:54.270925 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jun 17 11:48:54.270925 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jun 17 11:48:54.270925 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jun 17 11:48:54.270925 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jun 17 11:48:54.270925 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jun 17 11:48:54.270925 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jun 17 11:48:54.270925 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Id: 3a1f2372d9644a8a9ec0cbde578ab2d0 Jun 17 11:48:54.270925 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-VolumesNegativeTest-1485743726 Jun 17 11:48:54.270925 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Role: member,reader Jun 17 11:48:54.270925 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Roles: member,reader Jun 17 11:48:54.273674 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3a1f2372d9644a8a9ec0cbde578ab2d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3a1f2372d9644a8a9ec0cbde578ab2d0", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3a1f2372d9644a8a9ec0cbde578ab2d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3a1f2372d9644a8a9ec0cbde578ab2d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:48:54.273674 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-VolumesNegativeTest-1485743726 Jun 17 11:48:54.273674 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Id: 3a1f2372d9644a8a9ec0cbde578ab2d0 Jun 17 11:48:54.273674 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-VolumesNegativeTest-1485743726 Jun 17 11:48:54.273674 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User: tempest-VolumesNegativeTest-1485743726-project Jun 17 11:48:54.273674 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jun 17 11:48:54.273674 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jun 17 11:48:54.273674 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Id: 5f491879e9ca41fc932f9d5b0b5de24a Jun 17 11:48:54.273674 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-VolumesNegativeTest-1485743726-project Jun 17 11:48:54.273674 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: method: Jun 17 11:48:54.273674 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: exception: Volume 1749feca-e96d-4d03-96ad-3458d1244e18 could not be found. Jun 17 11:48:54.273674 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: action_args: {'id': '1749feca-e96d-4d03-96ad-3458d1244e18'} Jun 17 11:48:54.273674 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:48:54.274661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:54.274661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 11:48:54.274661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 11:48:54.274661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 11:48:54.274661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 11:48:54.274661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 11:48:54.274661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 11:48:54.274661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 11:48:54.274661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 11:48:54.274661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 11:48:54.274661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 11:48:54.274661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 11:48:54.274661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 11:48:54.274661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 11:48:54.274661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 11:48:54.274661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1749feca-e96d-4d03-96ad-3458d1244e18 could not be found. (HTTP 404) (Request-ID: req-1deedd8e-a9f6-4545-a4eb-ec36f46d6438) Jun 17 11:48:54.274661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.274661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:54.274661 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.275990 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:54.275990 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 17 11:48:54.275990 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 17 11:48:54.275990 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 11:48:54.275990 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 11:48:54.275990 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 11:48:54.275990 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 11:48:54.275990 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 11:48:54.275990 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 11:48:54.275990 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 11:48:54.275990 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 11:48:54.275990 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 11:48:54.275990 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 11:48:54.275990 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 11:48:54.275990 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 11:48:54.275990 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 11:48:54.275990 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 11:48:54.275990 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 11:48:54.275990 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 11:48:54.277147 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 11:48:54.277147 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 11:48:54.277147 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 11:48:54.277147 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 11:48:54.277147 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1749feca-e96d-4d03-96ad-3458d1244e18 could not be found. Jun 17 11:48:54.277147 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.277147 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:54.277147 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.277147 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:54.277147 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:54.277147 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:54.277147 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:48:54.277147 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:48:54.277147 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 11:48:54.277147 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 11:48:54.277147 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:48:54.277147 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:48:54.277147 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 17 11:48:54.277147 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:48:54.278450 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1749feca-e96d-4d03-96ad-3458d1244e18 could not be found. Jun 17 11:48:54.278450 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.278450 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:54.278450 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.278450 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:54.278450 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:54.278450 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:54.278450 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:48:54.278450 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:48:54.278450 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1749feca-e96d-4d03-96ad-3458d1244e18 could not be found. Jun 17 11:48:54.278450 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.278450 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c42efcaa-ed92-4e9c-b55b-111262abd4aa tempest-VolumesNegativeTest-1485743726 tempest-VolumesNegativeTest-1485743726-project] Returning 404 to user: Volume 1749feca-e96d-4d03-96ad-3458d1244e18 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:48:54.278450 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c42efcaa-ed92-4e9c-b55b-111262abd4aa tempest-VolumesNegativeTest-1485743726 tempest-VolumesNegativeTest-1485743726-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/1749feca-e96d-4d03-96ad-3458d1244e18" status: 404 len: 109 microversion: 2.1 time: 0.038764 Jun 17 11:48:54.278450 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 468/939] 10.222.0.45 () {58 vars in 1247 bytes} [Fri Jun 17 11:48:54 2022] DELETE /compute/v2.1/os-volumes/1749feca-e96d-4d03-96ad-3458d1244e18 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:48:54.286182 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-5fab2a46-94e3-417b-8822-626d27f668c3 tempest-VolumesNegativeTest-1485743726 tempest-VolumesNegativeTest-1485743726-project] Calling method '.version_select at 0x7f9c7b11a670>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:54.316983 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-5fab2a46-94e3-417b-8822-626d27f668c3 tempest-VolumesNegativeTest-1485743726 tempest-VolumesNegativeTest-1485743726-project] HTTP exception thrown: Volume b83db8fc-7596-417f-8130-efbab80ad473 could not be found. Jun 17 11:48:54.318623 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-5fab2a46-94e3-417b-8822-626d27f668c3 tempest-VolumesNegativeTest-1485743726 tempest-VolumesNegativeTest-1485743726-project] Request method failure captured: Jun 17 11:48:54.318623 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/os-volumes/b83db8fc-7596-417f-8130-efbab80ad473 HTTP/1.1 Jun 17 11:48:54.318623 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jun 17 11:48:54.318623 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jun 17 11:48:54.318623 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Connection: close Jun 17 11:48:54.318623 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jun 17 11:48:54.318623 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jun 17 11:48:54.318623 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.45 Jun 17 11:48:54.318623 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jun 17 11:48:54.318623 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jun 17 11:48:54.318623 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABirGolizFguPQknWWh1E99ipB0r-KFTUxYmSWIIIA3w1MkHZZLDZdtG8CpXs_NYBRS1WSJVo-GtgdOPZVd7R30jqQUvxrio7tuTy899-E7N_zLhg_uclO5jUhBc5h3uAEm3XvZRLuBniPvh2XbTu6W9RA6td_QepUrAm7mHuqezzY_9lE Jun 17 11:48:54.318623 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jun 17 11:48:54.318623 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jun 17 11:48:54.318623 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jun 17 11:48:54.318623 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jun 17 11:48:54.318623 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jun 17 11:48:54.318623 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jun 17 11:48:54.318623 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Id: 3a1f2372d9644a8a9ec0cbde578ab2d0 Jun 17 11:48:54.318623 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-VolumesNegativeTest-1485743726 Jun 17 11:48:54.318623 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jun 17 11:48:54.318623 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jun 17 11:48:54.322738 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3a1f2372d9644a8a9ec0cbde578ab2d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3a1f2372d9644a8a9ec0cbde578ab2d0", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3a1f2372d9644a8a9ec0cbde578ab2d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3a1f2372d9644a8a9ec0cbde578ab2d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:48:54.322738 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-VolumesNegativeTest-1485743726 Jun 17 11:48:54.322738 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: 3a1f2372d9644a8a9ec0cbde578ab2d0 Jun 17 11:48:54.322738 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-VolumesNegativeTest-1485743726 Jun 17 11:48:54.322738 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User: tempest-VolumesNegativeTest-1485743726-project Jun 17 11:48:54.322738 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jun 17 11:48:54.322738 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jun 17 11:48:54.322738 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Id: 5f491879e9ca41fc932f9d5b0b5de24a Jun 17 11:48:54.322738 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-VolumesNegativeTest-1485743726-project Jun 17 11:48:54.322738 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: method: Jun 17 11:48:54.322738 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: exception: Volume b83db8fc-7596-417f-8130-efbab80ad473 could not be found. Jun 17 11:48:54.322738 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: action_args: {'id': 'b83db8fc-7596-417f-8130-efbab80ad473'} Jun 17 11:48:54.322738 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:48:54.325468 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:54.325468 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 11:48:54.325468 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 11:48:54.325468 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 11:48:54.325468 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 11:48:54.325468 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 11:48:54.325468 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 11:48:54.325468 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 11:48:54.325468 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 11:48:54.325468 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 11:48:54.325468 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 11:48:54.325468 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 11:48:54.325468 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 11:48:54.325468 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 11:48:54.325468 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 11:48:54.325468 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b83db8fc-7596-417f-8130-efbab80ad473 could not be found. (HTTP 404) (Request-ID: req-ca57ad2b-f4d5-4115-b194-62f9a79a9441) Jun 17 11:48:54.325468 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.325468 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:54.325468 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.326877 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:54.326877 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 17 11:48:54.326877 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 17 11:48:54.326877 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 11:48:54.326877 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 11:48:54.326877 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 11:48:54.326877 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 11:48:54.326877 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 11:48:54.326877 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 11:48:54.326877 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 11:48:54.326877 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 11:48:54.326877 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 11:48:54.326877 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 11:48:54.326877 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 11:48:54.326877 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 11:48:54.326877 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 11:48:54.326877 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 11:48:54.326877 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 11:48:54.326877 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 11:48:54.330480 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 11:48:54.330480 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 11:48:54.330480 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 11:48:54.330480 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 11:48:54.330480 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b83db8fc-7596-417f-8130-efbab80ad473 could not be found. Jun 17 11:48:54.330480 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.330480 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:54.330480 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.330480 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:54.330480 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:54.330480 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:54.330480 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:48:54.330480 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:48:54.330480 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 11:48:54.330480 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 11:48:54.330480 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:48:54.330480 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:48:54.330480 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 17 11:48:54.330480 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:48:54.336985 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b83db8fc-7596-417f-8130-efbab80ad473 could not be found. Jun 17 11:48:54.336985 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.336985 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:54.336985 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.336985 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:54.336985 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:54.336985 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:54.336985 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:48:54.336985 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:48:54.336985 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b83db8fc-7596-417f-8130-efbab80ad473 could not be found. Jun 17 11:48:54.336985 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.336985 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-5fab2a46-94e3-417b-8822-626d27f668c3 tempest-VolumesNegativeTest-1485743726 tempest-VolumesNegativeTest-1485743726-project] Returning 404 to user: Volume b83db8fc-7596-417f-8130-efbab80ad473 could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:48:54.336985 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-5fab2a46-94e3-417b-8822-626d27f668c3 tempest-VolumesNegativeTest-1485743726 tempest-VolumesNegativeTest-1485743726-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/b83db8fc-7596-417f-8130-efbab80ad473" status: 404 len: 109 microversion: 2.1 time: 0.038425 Jun 17 11:48:54.336985 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 472/940] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jun 17 11:48:54 2022] GET /compute/v2.1/os-volumes/b83db8fc-7596-417f-8130-efbab80ad473 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:48:54.836210 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b13c6a5a-2497-423e-8af8-45e9ba944202 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:54.836783 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b13c6a5a-2497-423e-8af8-45e9ba944202 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:54.843767 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b13c6a5a-2497-423e-8af8-45e9ba944202 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:54.844326 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b13c6a5a-2497-423e-8af8-45e9ba944202 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:54.845144 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b13c6a5a-2497-423e-8af8-45e9ba944202 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:54.845647 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b13c6a5a-2497-423e-8af8-45e9ba944202 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:54.860320 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-b13c6a5a-2497-423e-8af8-45e9ba944202 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] HTTP exception thrown: Instance 71050501-8f84-4701-a013-bfc7a4459972 could not be found. Jun 17 11:48:54.862120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b13c6a5a-2497-423e-8af8-45e9ba944202 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Request method failure captured: Jun 17 11:48:54.862120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: request: DELETE /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 HTTP/1.1 Jun 17 11:48:54.862120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept: application/json Jun 17 11:48:54.862120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jun 17 11:48:54.862120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Connection: close Jun 17 11:48:54.862120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jun 17 11:48:54.862120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jun 17 11:48:54.862120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Host: 10.222.0.45 Jun 17 11:48:54.862120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jun 17 11:48:54.862120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jun 17 11:48:54.862120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABirGhbyTP6m8A6ocgcmCTbD2vtB5wliIaOyA8S7K2P96o-JRntRfJUSSZ-WD1QB-eTMm9Rz6lGJCOx-RLb0Rcq3CsQFid38C6tit0d8QF69DexK2qxFSYg5BUKaBJV8YlN8x7PJ8SeLm0KommhoQlq6Zz2O8A6Hy2IuR2pqoxEMVsxlg0 Jun 17 11:48:54.862120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jun 17 11:48:54.862120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jun 17 11:48:54.862120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jun 17 11:48:54.862120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jun 17 11:48:54.862120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 11:48:54.862120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jun 17 11:48:54.862120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jun 17 11:48:54.862120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Id: bc8dc1335e284eee8cca45d5720d5f16 Jun 17 11:48:54.862120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1476822038 Jun 17 11:48:54.862120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Role: member,reader Jun 17 11:48:54.862120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Roles: member,reader Jun 17 11:48:54.863824 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bc8dc1335e284eee8cca45d5720d5f16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bc8dc1335e284eee8cca45d5720d5f16", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bc8dc1335e284eee8cca45d5720d5f16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bc8dc1335e284eee8cca45d5720d5f16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:48:54.863824 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1476822038 Jun 17 11:48:54.863824 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Id: bc8dc1335e284eee8cca45d5720d5f16 Jun 17 11:48:54.863824 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1476822038 Jun 17 11:48:54.863824 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User: tempest-AttachVolumeShelveTestJSON-1476822038-project Jun 17 11:48:54.863824 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jun 17 11:48:54.863824 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jun 17 11:48:54.863824 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Id: d817bad669fc4d6f829bf6eb57773b23 Jun 17 11:48:54.863824 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1476822038-project Jun 17 11:48:54.863824 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: method: > Jun 17 11:48:54.863824 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: exception: Instance 71050501-8f84-4701-a013-bfc7a4459972 could not be found. Jun 17 11:48:54.863824 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: action_args: {'id': '71050501-8f84-4701-a013-bfc7a4459972'} Jun 17 11:48:54.864609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:48:54.864609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:54.864609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:48:54.864609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:48:54.864609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:48:54.864609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:48:54.864609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:48:54.864609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:48:54.864609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:48:54.864609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:48:54.864609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71050501-8f84-4701-a013-bfc7a4459972 could not be found. Jun 17 11:48:54.864609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.864609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:54.864609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.864609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:54.864609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:54.864609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:54.864609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:48:54.864609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:48:54.864609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:48:54.865837 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:48:54.865837 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 11:48:54.865837 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 11:48:54.865837 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 11:48:54.865837 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 11:48:54.865837 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:48:54.865837 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:48:54.865837 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:48:54.865837 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:48:54.865837 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71050501-8f84-4701-a013-bfc7a4459972 could not be found. Jun 17 11:48:54.865837 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.865837 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:54.865837 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.865837 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:54.865837 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:54.865837 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:54.865837 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:48:54.865837 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:48:54.865837 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71050501-8f84-4701-a013-bfc7a4459972 could not be found. Jun 17 11:48:54.865837 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.867042 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b13c6a5a-2497-423e-8af8-45e9ba944202 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Returning 404 to user: Instance 71050501-8f84-4701-a013-bfc7a4459972 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:48:54.867042 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b13c6a5a-2497-423e-8af8-45e9ba944202 tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "DELETE /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 404 len: 111 microversion: 2.20 time: 0.033248 Jun 17 11:48:54.867042 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 469/941] 10.222.0.45 () {60 vars in 1279 bytes} [Fri Jun 17 11:48:54 2022] DELETE /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 11:48:54.872791 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-aa855e1c-4670-473e-8faa-37fd2e7f920a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:54.873910 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-aa855e1c-4670-473e-8faa-37fd2e7f920a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] [instance: 71050501-8f84-4701-a013-bfc7a4459972] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:54.880115 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-aa855e1c-4670-473e-8faa-37fd2e7f920a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:54.880560 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-aa855e1c-4670-473e-8faa-37fd2e7f920a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:54.881329 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-aa855e1c-4670-473e-8faa-37fd2e7f920a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:54.881761 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-aa855e1c-4670-473e-8faa-37fd2e7f920a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:54.899338 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-aa855e1c-4670-473e-8faa-37fd2e7f920a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] HTTP exception thrown: Instance 71050501-8f84-4701-a013-bfc7a4459972 could not be found. Jun 17 11:48:54.900947 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-aa855e1c-4670-473e-8faa-37fd2e7f920a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Request method failure captured: Jun 17 11:48:54.900947 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 HTTP/1.1 Jun 17 11:48:54.900947 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jun 17 11:48:54.900947 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jun 17 11:48:54.900947 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Connection: close Jun 17 11:48:54.900947 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jun 17 11:48:54.900947 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jun 17 11:48:54.900947 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.45 Jun 17 11:48:54.900947 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jun 17 11:48:54.900947 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jun 17 11:48:54.900947 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABirGhbyTP6m8A6ocgcmCTbD2vtB5wliIaOyA8S7K2P96o-JRntRfJUSSZ-WD1QB-eTMm9Rz6lGJCOx-RLb0Rcq3CsQFid38C6tit0d8QF69DexK2qxFSYg5BUKaBJV8YlN8x7PJ8SeLm0KommhoQlq6Zz2O8A6Hy2IuR2pqoxEMVsxlg0 Jun 17 11:48:54.900947 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jun 17 11:48:54.900947 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jun 17 11:48:54.900947 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jun 17 11:48:54.900947 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jun 17 11:48:54.900947 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 11:48:54.900947 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jun 17 11:48:54.900947 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jun 17 11:48:54.900947 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Id: bc8dc1335e284eee8cca45d5720d5f16 Jun 17 11:48:54.900947 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1476822038 Jun 17 11:48:54.900947 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jun 17 11:48:54.900947 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jun 17 11:48:54.902883 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bc8dc1335e284eee8cca45d5720d5f16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bc8dc1335e284eee8cca45d5720d5f16", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bc8dc1335e284eee8cca45d5720d5f16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bc8dc1335e284eee8cca45d5720d5f16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:48:54.902883 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1476822038 Jun 17 11:48:54.902883 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: bc8dc1335e284eee8cca45d5720d5f16 Jun 17 11:48:54.902883 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1476822038 Jun 17 11:48:54.902883 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User: tempest-AttachVolumeShelveTestJSON-1476822038-project Jun 17 11:48:54.902883 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jun 17 11:48:54.902883 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jun 17 11:48:54.902883 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Id: d817bad669fc4d6f829bf6eb57773b23 Jun 17 11:48:54.902883 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1476822038-project Jun 17 11:48:54.902883 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: method: > Jun 17 11:48:54.902883 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: exception: Instance 71050501-8f84-4701-a013-bfc7a4459972 could not be found. Jun 17 11:48:54.902883 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: action_args: {'id': '71050501-8f84-4701-a013-bfc7a4459972'} Jun 17 11:48:54.904012 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:48:54.904012 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:54.904012 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:48:54.904012 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:48:54.904012 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:48:54.904012 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:48:54.904012 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:48:54.904012 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:48:54.904012 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:48:54.904012 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:48:54.904012 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71050501-8f84-4701-a013-bfc7a4459972 could not be found. Jun 17 11:48:54.904012 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.904012 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:54.904012 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.904012 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:54.904012 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:54.904012 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:54.904012 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:48:54.904012 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:48:54.904012 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:48:54.905419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:48:54.905419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 11:48:54.905419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 11:48:54.905419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:48:54.905419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:48:54.905419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:48:54.905419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:48:54.905419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71050501-8f84-4701-a013-bfc7a4459972 could not be found. Jun 17 11:48:54.905419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.905419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:48:54.905419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.905419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:48:54.905419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:48:54.905419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:48:54.905419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:48:54.905419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:48:54.905419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71050501-8f84-4701-a013-bfc7a4459972 could not be found. Jun 17 11:48:54.905419 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:48:54.906599 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-aa855e1c-4670-473e-8faa-37fd2e7f920a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] Returning 404 to user: Instance 71050501-8f84-4701-a013-bfc7a4459972 could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:48:54.906599 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-aa855e1c-4670-473e-8faa-37fd2e7f920a tempest-AttachVolumeShelveTestJSON-1476822038 tempest-AttachVolumeShelveTestJSON-1476822038-project] 10.222.0.45 "GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972" status: 404 len: 111 microversion: 2.20 time: 0.033561 Jun 17 11:48:54.906599 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 473/942] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 17 11:48:54 2022] GET /compute/v2.1/servers/71050501-8f84-4701-a013-bfc7a4459972 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 11:48:55.167885 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-7016edf2-a216-4128-a056-025c675fb918 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:55.168523 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7016edf2-a216-4128-a056-025c675fb918 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:55.176639 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7016edf2-a216-4128-a056-025c675fb918 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:55.177713 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7016edf2-a216-4128-a056-025c675fb918 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:55.178244 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7016edf2-a216-4128-a056-025c675fb918 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:55.179168 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7016edf2-a216-4128-a056-025c675fb918 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:55.446550 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7016edf2-a216-4128-a056-025c675fb918 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:55.454746 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-7016edf2-a216-4128-a056-025c675fb918 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1566 microversion: 2.1 time: 0.293560 Jun 17 11:48:55.455683 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 470/943] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:55 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1566 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:48:56.474433 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f50c27a1-c70d-4caa-9755-1a00930e214c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:56.475835 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f50c27a1-c70d-4caa-9755-1a00930e214c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:56.482589 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f50c27a1-c70d-4caa-9755-1a00930e214c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:56.483131 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f50c27a1-c70d-4caa-9755-1a00930e214c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:56.484015 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f50c27a1-c70d-4caa-9755-1a00930e214c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:56.484513 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f50c27a1-c70d-4caa-9755-1a00930e214c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:56.655404 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f50c27a1-c70d-4caa-9755-1a00930e214c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:56.664495 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f50c27a1-c70d-4caa-9755-1a00930e214c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1566 microversion: 2.1 time: 0.194316 Jun 17 11:48:56.674434 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 474/944] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:56 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1566 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:48:57.685442 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-802b4e77-e031-4bc2-96a6-5fd5468b71d0 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:57.687694 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-802b4e77-e031-4bc2-96a6-5fd5468b71d0 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:57.706077 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-802b4e77-e031-4bc2-96a6-5fd5468b71d0 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:57.706077 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-802b4e77-e031-4bc2-96a6-5fd5468b71d0 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:57.706077 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-802b4e77-e031-4bc2-96a6-5fd5468b71d0 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:57.706348 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-802b4e77-e031-4bc2-96a6-5fd5468b71d0 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:57.915673 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-802b4e77-e031-4bc2-96a6-5fd5468b71d0 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:57.924202 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-802b4e77-e031-4bc2-96a6-5fd5468b71d0 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1566 microversion: 2.1 time: 0.243726 Jun 17 11:48:57.924712 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 471/945] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:57 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1566 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:48:58.942204 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-63e29098-f835-4259-a2ab-9bfc018ed32c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:58.942825 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-63e29098-f835-4259-a2ab-9bfc018ed32c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:58.967683 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-63e29098-f835-4259-a2ab-9bfc018ed32c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:58.968142 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-63e29098-f835-4259-a2ab-9bfc018ed32c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:58.969140 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-63e29098-f835-4259-a2ab-9bfc018ed32c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:58.969747 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-63e29098-f835-4259-a2ab-9bfc018ed32c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:59.015248 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=100 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:48:59.203760 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-63e29098-f835-4259-a2ab-9bfc018ed32c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:59.221174 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-63e29098-f835-4259-a2ab-9bfc018ed32c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1507 microversion: 2.1 time: 0.282862 Jun 17 11:48:59.222099 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 475/946] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:58 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1507 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:48:59.244011 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-115132b5-a135-4aa8-a9c6-6b5c0417b89d tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:48:59.244597 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-115132b5-a135-4aa8-a9c6-6b5c0417b89d tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:59.251467 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-115132b5-a135-4aa8-a9c6-6b5c0417b89d tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:59.252161 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-115132b5-a135-4aa8-a9c6-6b5c0417b89d tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:59.253127 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-115132b5-a135-4aa8-a9c6-6b5c0417b89d tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:59.254159 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-115132b5-a135-4aa8-a9c6-6b5c0417b89d tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:59.607900 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-115132b5-a135-4aa8-a9c6-6b5c0417b89d tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "POST /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c/action" status: 202 len: 0 microversion: 2.1 time: 0.369194 Jun 17 11:48:59.613019 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 472/947] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jun 17 11:48:59 2022] POST /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 11:48:59.620310 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-dcbed67f-ecc8-4c89-9c34-f2fe3b6bba3f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:48:59.621221 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-dcbed67f-ecc8-4c89-9c34-f2fe3b6bba3f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:48:59.629122 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-dcbed67f-ecc8-4c89-9c34-f2fe3b6bba3f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:59.631078 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-dcbed67f-ecc8-4c89-9c34-f2fe3b6bba3f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:59.631078 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-dcbed67f-ecc8-4c89-9c34-f2fe3b6bba3f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:59.631976 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-dcbed67f-ecc8-4c89-9c34-f2fe3b6bba3f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:59.826673 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-dcbed67f-ecc8-4c89-9c34-f2fe3b6bba3f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:48:59.838926 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-dcbed67f-ecc8-4c89-9c34-f2fe3b6bba3f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1515 microversion: 2.1 time: 0.223096 Jun 17 11:48:59.840402 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 476/948] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:48:59 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1515 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:48:59.871865 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-bfbf1030-896a-4dc9-870b-4d0c1fa558c8 req-063acdc9-2482-40e4-b4fc-6dbc0a08cd98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef2e4aca-bc09-41dd-9f63-3a8649cf871c", "name": "network-vif-unplugged", "status": "completed", "tag": "0b44766a-48d1-49bc-a348-b25e0252287f"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:48:59.891910 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-bfbf1030-896a-4dc9-870b-4d0c1fa558c8 req-063acdc9-2482-40e4-b4fc-6dbc0a08cd98 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:48:59.892626 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-bfbf1030-896a-4dc9-870b-4d0c1fa558c8 req-063acdc9-2482-40e4-b4fc-6dbc0a08cd98 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:48:59.908909 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.compute.server_external_events [req-bfbf1030-896a-4dc9-870b-4d0c1fa558c8 req-063acdc9-2482-40e4-b4fc-6dbc0a08cd98 service nova] Unable to find a host for instance ef2e4aca-bc09-41dd-9f63-3a8649cf871c. Dropping event network-vif-unplugged {{(pid=124844) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 17 11:48:59.909987 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-bfbf1030-896a-4dc9-870b-4d0c1fa558c8 req-063acdc9-2482-40e4-b4fc-6dbc0a08cd98 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.045435 Jun 17 11:48:59.910641 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 473/949] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 47 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 17 11:49:00.865119 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b578905c-75db-49c2-a1fd-0947307a6013 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:00.870267 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b578905c-75db-49c2-a1fd-0947307a6013 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:49:00.870267 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:49:00.879251 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b578905c-75db-49c2-a1fd-0947307a6013 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:00.879633 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b578905c-75db-49c2-a1fd-0947307a6013 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:00.880443 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b578905c-75db-49c2-a1fd-0947307a6013 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:00.880881 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b578905c-75db-49c2-a1fd-0947307a6013 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:01.104123 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b578905c-75db-49c2-a1fd-0947307a6013 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:49:01.119921 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b578905c-75db-49c2-a1fd-0947307a6013 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1515 microversion: 2.1 time: 0.258564 Jun 17 11:49:01.120988 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 477/950] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:49:00 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1515 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:49:02.147071 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2e38d047-d98e-4ec6-b1c8-8cc3e1162c8f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:02.147765 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-2e38d047-d98e-4ec6-b1c8-8cc3e1162c8f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:49:02.149782 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:49:02.154623 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2e38d047-d98e-4ec6-b1c8-8cc3e1162c8f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:02.155070 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2e38d047-d98e-4ec6-b1c8-8cc3e1162c8f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:02.155873 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2e38d047-d98e-4ec6-b1c8-8cc3e1162c8f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:02.156309 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2e38d047-d98e-4ec6-b1c8-8cc3e1162c8f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:02.327349 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2e38d047-d98e-4ec6-b1c8-8cc3e1162c8f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:49:02.335928 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2e38d047-d98e-4ec6-b1c8-8cc3e1162c8f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1517 microversion: 2.1 time: 0.192650 Jun 17 11:49:02.336522 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 474/951] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:49:02 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1517 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:49:03.357812 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-d3803cb1-2d29-41cf-ae64-d9da8c7b05ad tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:03.358680 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-d3803cb1-2d29-41cf-ae64-d9da8c7b05ad tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:49:03.365477 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d3803cb1-2d29-41cf-ae64-d9da8c7b05ad tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:03.365926 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d3803cb1-2d29-41cf-ae64-d9da8c7b05ad tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:03.367932 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d3803cb1-2d29-41cf-ae64-d9da8c7b05ad tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:03.373660 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d3803cb1-2d29-41cf-ae64-d9da8c7b05ad tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:03.526168 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-d3803cb1-2d29-41cf-ae64-d9da8c7b05ad tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:49:03.534214 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-d3803cb1-2d29-41cf-ae64-d9da8c7b05ad tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1573 microversion: 2.1 time: 0.180760 Jun 17 11:49:03.535054 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 478/952] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:49:03 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1573 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:49:04.551816 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f5849d14-4b27-4566-b845-338f41aceba1 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:04.552439 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f5849d14-4b27-4566-b845-338f41aceba1 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:49:04.559531 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f5849d14-4b27-4566-b845-338f41aceba1 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:04.559994 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f5849d14-4b27-4566-b845-338f41aceba1 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:04.568912 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f5849d14-4b27-4566-b845-338f41aceba1 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:04.568912 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f5849d14-4b27-4566-b845-338f41aceba1 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:04.704089 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f5849d14-4b27-4566-b845-338f41aceba1 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:49:04.712712 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f5849d14-4b27-4566-b845-338f41aceba1 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1573 microversion: 2.1 time: 0.165084 Jun 17 11:49:04.713293 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 475/953] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:49:04 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1573 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:49:05.734466 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-aef6b121-ae0a-4e0d-8367-68052e4ea8e7 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:05.735073 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-aef6b121-ae0a-4e0d-8367-68052e4ea8e7 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:49:05.742872 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-aef6b121-ae0a-4e0d-8367-68052e4ea8e7 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:05.743320 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-aef6b121-ae0a-4e0d-8367-68052e4ea8e7 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:05.744118 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-aef6b121-ae0a-4e0d-8367-68052e4ea8e7 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:05.744552 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-aef6b121-ae0a-4e0d-8367-68052e4ea8e7 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:05.898980 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-aef6b121-ae0a-4e0d-8367-68052e4ea8e7 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:49:05.902066 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-aef6b121-ae0a-4e0d-8367-68052e4ea8e7 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1573 microversion: 2.1 time: 0.171583 Jun 17 11:49:05.902650 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 479/954] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:49:05 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1573 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:49:06.920470 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d9305c97-d746-4f9c-b6f0-e341cc03f3af tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:06.921090 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d9305c97-d746-4f9c-b6f0-e341cc03f3af tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:49:06.927597 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d9305c97-d746-4f9c-b6f0-e341cc03f3af tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:06.928047 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d9305c97-d746-4f9c-b6f0-e341cc03f3af tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:06.930453 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d9305c97-d746-4f9c-b6f0-e341cc03f3af tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:06.930914 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d9305c97-d746-4f9c-b6f0-e341cc03f3af tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:07.055509 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-83dad8d3-6e82-4817-9cea-2435549f697a tempest-VolumesTestJSON-1078205796 tempest-VolumesTestJSON-1078205796-project] Calling method '.version_select at 0x7f9c767489d0>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:07.074528 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d9305c97-d746-4f9c-b6f0-e341cc03f3af tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:49:07.082503 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d9305c97-d746-4f9c-b6f0-e341cc03f3af tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1573 microversion: 2.1 time: 0.165893 Jun 17 11:49:07.083068 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 476/955] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:49:06 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:49:07.104275 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-83dad8d3-6e82-4817-9cea-2435549f697a tempest-VolumesTestJSON-1078205796 tempest-VolumesTestJSON-1078205796-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/2e0457c3-0640-4cbc-8564-e38325a15ba2" status: 200 len: 351 microversion: 2.1 time: 0.053595 Jun 17 11:49:07.110802 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 480/956] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jun 17 11:49:07 2022] GET /compute/v2.1/os-volumes/2e0457c3-0640-4cbc-8564-e38325a15ba2 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:49:08.100089 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a391297b-c725-4473-b24b-7953674bddc8 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:08.101244 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a391297b-c725-4473-b24b-7953674bddc8 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:49:08.108333 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a391297b-c725-4473-b24b-7953674bddc8 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:08.108788 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a391297b-c725-4473-b24b-7953674bddc8 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:08.109776 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a391297b-c725-4473-b24b-7953674bddc8 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:08.110286 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a391297b-c725-4473-b24b-7953674bddc8 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:08.275071 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a391297b-c725-4473-b24b-7953674bddc8 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:49:08.283025 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a391297b-c725-4473-b24b-7953674bddc8 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1573 microversion: 2.1 time: 0.186853 Jun 17 11:49:08.283650 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 477/957] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:49:08 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1573 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:49:09.300821 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-32d51c23-4299-409e-b57b-3ffd305e0f2f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:09.301438 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-32d51c23-4299-409e-b57b-3ffd305e0f2f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:49:09.310166 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-32d51c23-4299-409e-b57b-3ffd305e0f2f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:09.310622 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-32d51c23-4299-409e-b57b-3ffd305e0f2f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:09.311434 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-32d51c23-4299-409e-b57b-3ffd305e0f2f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:09.311877 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-32d51c23-4299-409e-b57b-3ffd305e0f2f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:09.478867 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-32d51c23-4299-409e-b57b-3ffd305e0f2f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:49:09.486948 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-32d51c23-4299-409e-b57b-3ffd305e0f2f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1573 microversion: 2.1 time: 0.190761 Jun 17 11:49:09.487552 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 481/958] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:49:09 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1573 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:49:10.077746 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-de140fee-2548-4938-a86d-b19ab89d261f tempest-VolumesTestJSON-1078205796 tempest-VolumesTestJSON-1078205796-project] Calling method '.version_select at 0x7f9c7677faf0>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:10.129752 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-de140fee-2548-4938-a86d-b19ab89d261f tempest-VolumesTestJSON-1078205796 tempest-VolumesTestJSON-1078205796-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/ba9eaa41-6334-45c6-904b-7b6f1a0ac31d" status: 200 len: 351 microversion: 2.1 time: 0.055663 Jun 17 11:49:10.131101 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 478/959] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jun 17 11:49:10 2022] GET /compute/v2.1/os-volumes/ba9eaa41-6334-45c6-904b-7b6f1a0ac31d => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:49:10.504737 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-5b52cec6-cce5-4c6c-a529-74738800e354 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:10.505321 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-5b52cec6-cce5-4c6c-a529-74738800e354 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:49:10.512994 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5b52cec6-cce5-4c6c-a529-74738800e354 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:10.513481 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5b52cec6-cce5-4c6c-a529-74738800e354 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:10.514273 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5b52cec6-cce5-4c6c-a529-74738800e354 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:10.514720 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5b52cec6-cce5-4c6c-a529-74738800e354 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:10.664254 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5b52cec6-cce5-4c6c-a529-74738800e354 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:49:10.672072 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-5b52cec6-cce5-4c6c-a529-74738800e354 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1573 microversion: 2.1 time: 0.171664 Jun 17 11:49:10.672634 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 482/960] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:49:10 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1573 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:49:11.690739 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-dd6e728a-53ee-47f5-86ed-d5203e7cd778 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:11.691651 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-dd6e728a-53ee-47f5-86ed-d5203e7cd778 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:49:11.700345 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dd6e728a-53ee-47f5-86ed-d5203e7cd778 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:11.700799 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dd6e728a-53ee-47f5-86ed-d5203e7cd778 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:11.701776 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dd6e728a-53ee-47f5-86ed-d5203e7cd778 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:11.702336 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dd6e728a-53ee-47f5-86ed-d5203e7cd778 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:11.906066 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-dd6e728a-53ee-47f5-86ed-d5203e7cd778 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:49:11.917608 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-dd6e728a-53ee-47f5-86ed-d5203e7cd778 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1573 microversion: 2.1 time: 0.231756 Jun 17 11:49:11.919112 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 479/961] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:49:11 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1573 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:49:11.925460 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-3a6f5808-22ce-47f6-a72e-c42aa7fd1079 tempest-VolumesTestJSON-1078205796 tempest-VolumesTestJSON-1078205796-project] Calling method '.version_select at 0x7f9c7695b310>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:11.988956 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-3a6f5808-22ce-47f6-a72e-c42aa7fd1079 tempest-VolumesTestJSON-1078205796 tempest-VolumesTestJSON-1078205796-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/f1c093e6-a7dd-4a0b-b30c-6f410304a57f" status: 200 len: 351 microversion: 2.1 time: 0.067905 Jun 17 11:49:11.989559 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 483/962] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jun 17 11:49:11 2022] GET /compute/v2.1/os-volumes/f1c093e6-a7dd-4a0b-b30c-6f410304a57f => generated 351 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:49:12.000875 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2f8fbd7a-d186-45c2-a662-4e3ee3fc8a2c tempest-VolumesTestJSON-1078205796 tempest-VolumesTestJSON-1078205796-project] Calling method '.version_select at 0x7f9c76756940>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:12.090155 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2f8fbd7a-d186-45c2-a662-4e3ee3fc8a2c tempest-VolumesTestJSON-1078205796 tempest-VolumesTestJSON-1078205796-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.093033 Jun 17 11:49:12.090835 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 480/963] 10.222.0.45 () {58 vars in 1133 bytes} [Fri Jun 17 11:49:11 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:49:12.103047 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e42f3e6d-4d52-4ebc-b6ef-0368ab00226e tempest-VolumesTestJSON-1078205796 tempest-VolumesTestJSON-1078205796-project] Calling method '.version_select at 0x7f9c768fe790>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:12.185172 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-e42f3e6d-4d52-4ebc-b6ef-0368ab00226e tempest-VolumesTestJSON-1078205796 tempest-VolumesTestJSON-1078205796-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.085841 Jun 17 11:49:12.185784 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 484/964] 10.222.0.45 () {58 vars in 1148 bytes} [Fri Jun 17 11:49:12 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:49:12.197861 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-56ddcfd7-e8b9-4f43-9277-3b50b8cc3468 tempest-VolumesTestJSON-1078205796 tempest-VolumesTestJSON-1078205796-project] Calling method '.version_select at 0x7f9c7677f1f0>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:12.281730 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-56ddcfd7-e8b9-4f43-9277-3b50b8cc3468 tempest-VolumesTestJSON-1078205796 tempest-VolumesTestJSON-1078205796-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.087650 Jun 17 11:49:12.281932 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 481/965] 10.222.0.45 () {58 vars in 1133 bytes} [Fri Jun 17 11:49:12 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:49:12.294752 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-87e414e1-ed0a-4d1d-bd46-c9ba019f407a tempest-VolumesTestJSON-1078205796 tempest-VolumesTestJSON-1078205796-project] Calling method '.version_select at 0x7f9c76925940>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:12.376140 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-87e414e1-ed0a-4d1d-bd46-c9ba019f407a tempest-VolumesTestJSON-1078205796 tempest-VolumesTestJSON-1078205796-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085204 Jun 17 11:49:12.377000 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 485/966] 10.222.0.45 () {58 vars in 1166 bytes} [Fri Jun 17 11:49:12 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:49:12.389404 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b86e1422-95a0-4364-9a3f-eb270694fde2 tempest-VolumesTestJSON-1078205796 tempest-VolumesTestJSON-1078205796-project] Calling method '.version_select at 0x7f9c766eb5e0>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:12.471286 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b86e1422-95a0-4364-9a3f-eb270694fde2 tempest-VolumesTestJSON-1078205796 tempest-VolumesTestJSON-1078205796-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.085825 Jun 17 11:49:12.471971 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 482/967] 10.222.0.45 () {58 vars in 1169 bytes} [Fri Jun 17 11:49:12 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:49:12.483970 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-fae04a44-bc00-4ac1-9953-2d19c5fca27e tempest-VolumesTestJSON-1078205796 tempest-VolumesTestJSON-1078205796-project] Calling method '.version_select at 0x7f9c769250d0>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:12.565252 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-fae04a44-bc00-4ac1-9953-2d19c5fca27e tempest-VolumesTestJSON-1078205796 tempest-VolumesTestJSON-1078205796-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.085085 Jun 17 11:49:12.565833 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 486/968] 10.222.0.45 () {58 vars in 1154 bytes} [Fri Jun 17 11:49:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:49:12.583157 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e4c0a0f6-e330-42c0-b03e-2c3bae2fac8d tempest-VolumesTestJSON-1078205796 tempest-VolumesTestJSON-1078205796-project] Calling method '.version_select at 0x7f9c766eb280>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:12.669276 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e4c0a0f6-e330-42c0-b03e-2c3bae2fac8d tempest-VolumesTestJSON-1078205796 tempest-VolumesTestJSON-1078205796-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089813 Jun 17 11:49:12.669851 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 483/969] 10.222.0.45 () {58 vars in 1187 bytes} [Fri Jun 17 11:49:12 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:49:12.681538 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-eebb51f1-3adc-4177-8a0c-5090ec2260b8 tempest-VolumesTestJSON-1078205796 tempest-VolumesTestJSON-1078205796-project] Calling method '.version_select at 0x7f9c768feaf0>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:12.914962 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-eebb51f1-3adc-4177-8a0c-5090ec2260b8 tempest-VolumesTestJSON-1078205796 tempest-VolumesTestJSON-1078205796-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.237404 Jun 17 11:49:12.915994 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 487/970] 10.222.0.45 () {58 vars in 1154 bytes} [Fri Jun 17 11:49:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:49:12.936480 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-88b39d26-040e-4451-835c-729513b7be57 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:12.937102 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-88b39d26-040e-4451-835c-729513b7be57 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:49:12.943618 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-88b39d26-040e-4451-835c-729513b7be57 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:12.944664 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-88b39d26-040e-4451-835c-729513b7be57 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:12.945678 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-88b39d26-040e-4451-835c-729513b7be57 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:12.946121 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-88b39d26-040e-4451-835c-729513b7be57 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:13.086782 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-88b39d26-040e-4451-835c-729513b7be57 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:49:13.095635 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-88b39d26-040e-4451-835c-729513b7be57 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1573 microversion: 2.1 time: 0.163495 Jun 17 11:49:13.096254 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 484/971] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:49:12 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1573 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:49:14.119507 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-5a1dee87-15ce-4f7b-806c-7d66088a44e5 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:14.120179 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-5a1dee87-15ce-4f7b-806c-7d66088a44e5 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:49:14.127206 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5a1dee87-15ce-4f7b-806c-7d66088a44e5 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:14.127715 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5a1dee87-15ce-4f7b-806c-7d66088a44e5 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:14.128488 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5a1dee87-15ce-4f7b-806c-7d66088a44e5 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:14.128940 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5a1dee87-15ce-4f7b-806c-7d66088a44e5 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:14.311227 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5a1dee87-15ce-4f7b-806c-7d66088a44e5 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:49:14.320296 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-5a1dee87-15ce-4f7b-806c-7d66088a44e5 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1573 microversion: 2.1 time: 0.205346 Jun 17 11:49:14.330463 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 488/972] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:49:14 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1573 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:49:15.337938 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-30c40447-6b28-439f-86a8-1658ceb9d3b3 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:15.338720 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-30c40447-6b28-439f-86a8-1658ceb9d3b3 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:49:15.346048 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-30c40447-6b28-439f-86a8-1658ceb9d3b3 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:15.346499 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-30c40447-6b28-439f-86a8-1658ceb9d3b3 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:15.347283 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-30c40447-6b28-439f-86a8-1658ceb9d3b3 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:15.347749 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-30c40447-6b28-439f-86a8-1658ceb9d3b3 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:15.491535 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-30c40447-6b28-439f-86a8-1658ceb9d3b3 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:49:15.504258 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-30c40447-6b28-439f-86a8-1658ceb9d3b3 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1573 microversion: 2.1 time: 0.170084 Jun 17 11:49:15.505313 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 485/973] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:49:15 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1573 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:49:16.521839 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-d3d21ea8-011d-411f-a05d-f52e6fe19da8 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:16.527278 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-d3d21ea8-011d-411f-a05d-f52e6fe19da8 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:49:16.529399 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d3d21ea8-011d-411f-a05d-f52e6fe19da8 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:16.529853 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d3d21ea8-011d-411f-a05d-f52e6fe19da8 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:16.530636 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d3d21ea8-011d-411f-a05d-f52e6fe19da8 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:16.531078 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d3d21ea8-011d-411f-a05d-f52e6fe19da8 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:16.686226 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-d3d21ea8-011d-411f-a05d-f52e6fe19da8 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:49:16.692686 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-d3d21ea8-011d-411f-a05d-f52e6fe19da8 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1573 microversion: 2.1 time: 0.174761 Jun 17 11:49:16.704381 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 489/974] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:49:16 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1573 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:49:17.710676 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6174c07f-1bf0-4c86-845b-43c779f96cb6 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:17.711463 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-6174c07f-1bf0-4c86-845b-43c779f96cb6 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:49:17.718134 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6174c07f-1bf0-4c86-845b-43c779f96cb6 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:17.718580 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6174c07f-1bf0-4c86-845b-43c779f96cb6 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:17.719340 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6174c07f-1bf0-4c86-845b-43c779f96cb6 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:17.719806 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6174c07f-1bf0-4c86-845b-43c779f96cb6 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:17.738056 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:49:17.907028 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-6174c07f-1bf0-4c86-845b-43c779f96cb6 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:49:17.917415 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-6174c07f-1bf0-4c86-845b-43c779f96cb6 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1573 microversion: 2.1 time: 0.210416 Jun 17 11:49:17.918081 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 486/975] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:49:17 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1573 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:49:18.938218 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c8137bd9-6df5-4332-90f9-3d4ea2e02f88 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:18.938976 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c8137bd9-6df5-4332-90f9-3d4ea2e02f88 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:49:18.947304 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c8137bd9-6df5-4332-90f9-3d4ea2e02f88 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:18.947785 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c8137bd9-6df5-4332-90f9-3d4ea2e02f88 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:18.952251 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c8137bd9-6df5-4332-90f9-3d4ea2e02f88 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:18.952251 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c8137bd9-6df5-4332-90f9-3d4ea2e02f88 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:19.102093 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c8137bd9-6df5-4332-90f9-3d4ea2e02f88 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:49:19.110129 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c8137bd9-6df5-4332-90f9-3d4ea2e02f88 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1573 microversion: 2.1 time: 0.176982 Jun 17 11:49:19.110707 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 490/976] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:49:18 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1573 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:49:19.983580 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-62e23a46-6ed3-45aa-9eeb-ac2658b5c0b5 req-f04b0b38-6d8f-4d57-bb7a-eccbfaf86a57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef2e4aca-bc09-41dd-9f63-3a8649cf871c", "name": "network-vif-plugged", "status": "completed", "tag": "0b44766a-48d1-49bc-a348-b25e0252287f"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:49:19.994561 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-62e23a46-6ed3-45aa-9eeb-ac2658b5c0b5 req-f04b0b38-6d8f-4d57-bb7a-eccbfaf86a57 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:19.995066 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-62e23a46-6ed3-45aa-9eeb-ac2658b5c0b5 req-f04b0b38-6d8f-4d57-bb7a-eccbfaf86a57 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:20.008119 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-62e23a46-6ed3-45aa-9eeb-ac2658b5c0b5 req-f04b0b38-6d8f-4d57-bb7a-eccbfaf86a57 service nova] Creating event network-vif-plugged:0b44766a-48d1-49bc-a348-b25e0252287f for instance ef2e4aca-bc09-41dd-9f63-3a8649cf871c on hv-cinder-83716 Jun 17 11:49:20.013092 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-62e23a46-6ed3-45aa-9eeb-ac2658b5c0b5 req-f04b0b38-6d8f-4d57-bb7a-eccbfaf86a57 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034554 Jun 17 11:49:20.014112 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 487/977] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:49:20.129941 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0cf0a06b-a4cc-4c6d-bb9c-dd9702f9bbd7 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:20.131182 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0cf0a06b-a4cc-4c6d-bb9c-dd9702f9bbd7 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:49:20.142340 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0cf0a06b-a4cc-4c6d-bb9c-dd9702f9bbd7 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:20.142795 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0cf0a06b-a4cc-4c6d-bb9c-dd9702f9bbd7 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:20.155953 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0cf0a06b-a4cc-4c6d-bb9c-dd9702f9bbd7 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:20.156756 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0cf0a06b-a4cc-4c6d-bb9c-dd9702f9bbd7 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:20.318647 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0cf0a06b-a4cc-4c6d-bb9c-dd9702f9bbd7 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:49:20.327822 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0cf0a06b-a4cc-4c6d-bb9c-dd9702f9bbd7 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1573 microversion: 2.1 time: 0.203062 Jun 17 11:49:20.328453 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 491/978] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:49:20 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1573 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:49:21.348452 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6c2aa5ad-56b6-4d54-b727-5db910650e45 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:21.349070 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-6c2aa5ad-56b6-4d54-b727-5db910650e45 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:49:21.357072 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6c2aa5ad-56b6-4d54-b727-5db910650e45 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:21.357516 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6c2aa5ad-56b6-4d54-b727-5db910650e45 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:21.358306 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6c2aa5ad-56b6-4d54-b727-5db910650e45 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:21.358739 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6c2aa5ad-56b6-4d54-b727-5db910650e45 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:21.532943 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-6c2aa5ad-56b6-4d54-b727-5db910650e45 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:49:21.540852 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-6c2aa5ad-56b6-4d54-b727-5db910650e45 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1573 microversion: 2.1 time: 0.197505 Jun 17 11:49:21.541608 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 488/979] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:49:21 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1573 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:49:22.559392 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4158fff3-6454-4950-a579-d9b17a234f5b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:22.560040 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4158fff3-6454-4950-a579-d9b17a234f5b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:49:22.566970 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4158fff3-6454-4950-a579-d9b17a234f5b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:22.567452 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4158fff3-6454-4950-a579-d9b17a234f5b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:22.568259 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4158fff3-6454-4950-a579-d9b17a234f5b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:22.568703 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4158fff3-6454-4950-a579-d9b17a234f5b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:22.735544 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-4158fff3-6454-4950-a579-d9b17a234f5b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:49:22.744053 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4158fff3-6454-4950-a579-d9b17a234f5b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1573 microversion: 2.1 time: 0.188578 Jun 17 11:49:22.744641 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 492/980] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:49:22 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1573 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:49:23.762167 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-7ebcfcf9-8d87-4a8c-b5e2-c95e69ed2cd3 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:23.762714 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7ebcfcf9-8d87-4a8c-b5e2-c95e69ed2cd3 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:49:23.769703 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7ebcfcf9-8d87-4a8c-b5e2-c95e69ed2cd3 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:23.770157 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7ebcfcf9-8d87-4a8c-b5e2-c95e69ed2cd3 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:23.770938 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7ebcfcf9-8d87-4a8c-b5e2-c95e69ed2cd3 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:23.771390 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7ebcfcf9-8d87-4a8c-b5e2-c95e69ed2cd3 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:23.908359 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7ebcfcf9-8d87-4a8c-b5e2-c95e69ed2cd3 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:49:23.917102 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-7ebcfcf9-8d87-4a8c-b5e2-c95e69ed2cd3 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1573 microversion: 2.1 time: 0.159400 Jun 17 11:49:23.917796 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 489/981] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:49:23 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1573 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:49:24.525844 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-7b45c190-a05f-44fb-bd5b-2d08a7c71173 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2106952529", "imageRef": "272eb2b7-ddf0-433f-8be8-cdc13c01be77", "flavorRef": "452", "networks": [{"uuid": "48b15f3b-e7e5-459b-b54f-217e63bb1295"}]}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:49:24.585977 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.network.neutron [None req-7b45c190-a05f-44fb-bd5b-2d08a7c71173 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] validate_networks() for [('48b15f3b-e7e5-459b-b54f-217e63bb1295', None, None, None, None, None)] {{(pid=124845) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 11:49:24.936537 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3f64a902-a4c2-4e4d-98e0-7ca5dc19104c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:24.937159 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-3f64a902-a4c2-4e4d-98e0-7ca5dc19104c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:49:24.950441 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3f64a902-a4c2-4e4d-98e0-7ca5dc19104c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:24.951232 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3f64a902-a4c2-4e4d-98e0-7ca5dc19104c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:24.952800 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3f64a902-a4c2-4e4d-98e0-7ca5dc19104c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:24.953421 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3f64a902-a4c2-4e4d-98e0-7ca5dc19104c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:25.155759 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-7b45c190-a05f-44fb-bd5b-2d08a7c71173 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Flavor limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 11:49:25.156281 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-7b45c190-a05f-44fb-bd5b-2d08a7c71173 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Image limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 11:49:25.156859 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-7b45c190-a05f-44fb-bd5b-2d08a7c71173 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Flavor pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 11:49:25.157339 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-7b45c190-a05f-44fb-bd5b-2d08a7c71173 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Image pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 11:49:25.157828 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-7b45c190-a05f-44fb-bd5b-2d08a7c71173 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 11:49:25.171295 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7b45c190-a05f-44fb-bd5b-2d08a7c71173 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:25.171295 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7b45c190-a05f-44fb-bd5b-2d08a7c71173 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:25.171295 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7b45c190-a05f-44fb-bd5b-2d08a7c71173 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:25.171295 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7b45c190-a05f-44fb-bd5b-2d08a7c71173 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:25.175543 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3f64a902-a4c2-4e4d-98e0-7ca5dc19104c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:49:25.184075 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-3f64a902-a4c2-4e4d-98e0-7ca5dc19104c tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1560 microversion: 2.1 time: 0.253058 Jun 17 11:49:25.187328 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-7b45c190-a05f-44fb-bd5b-2d08a7c71173 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Getting quotas for project eab294243e474e34a2c6eec07747bf0d. Resources: {'instances', 'ram', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 11:49:25.188691 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 490/982] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:49:24 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1560 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:49:25.191527 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-7b45c190-a05f-44fb-bd5b-2d08a7c71173 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Getting quotas for user fdbcf7bbf6ef4e9a9a1e7ab5802ce12d and project eab294243e474e34a2c6eec07747bf0d. Resources: {'instances', 'ram', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 11:49:25.204731 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-7b45c190-a05f-44fb-bd5b-2d08a7c71173 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Going to run 1 instances... {{(pid=124845) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 11:49:25.207055 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-7b45c190-a05f-44fb-bd5b-2d08a7c71173 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: e95f5fca-3e9f-4b8a-939a-110a184fc0b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='272eb2b7-ddf0-433f-8be8-cdc13c01be77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 11:49:25.376840 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-7b45c190-a05f-44fb-bd5b-2d08a7c71173 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.853112 Jun 17 11:49:25.376840 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 493/983] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 17 11:49:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 11:49:25.390502 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e1f64537-caca-4051-9b44-ea5c7ef6d4c8 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:25.392607 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e1f64537-caca-4051-9b44-ea5c7ef6d4c8 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: e95f5fca-3e9f-4b8a-939a-110a184fc0b0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:49:25.455734 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e1f64537-caca-4051-9b44-ea5c7ef6d4c8 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:49:25.464675 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e1f64537-caca-4051-9b44-ea5c7ef6d4c8 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0" status: 200 len: 1219 microversion: 2.1 time: 0.080527 Jun 17 11:49:25.466250 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 491/984] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:49:25 2022] GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:49:26.484441 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-efdac1e5-ea82-408b-8c98-0344af47a4ef tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:26.486032 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-efdac1e5-ea82-408b-8c98-0344af47a4ef tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: e95f5fca-3e9f-4b8a-939a-110a184fc0b0] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:49:26.552790 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-efdac1e5-ea82-408b-8c98-0344af47a4ef tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:49:26.560971 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-efdac1e5-ea82-408b-8c98-0344af47a4ef tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0" status: 200 len: 1219 microversion: 2.1 time: 0.081505 Jun 17 11:49:26.561668 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 494/985] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:49:26 2022] GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:49:27.581157 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d947cfce-d823-4ffe-a7fe-c1f30b966d67 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:27.581157 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d947cfce-d823-4ffe-a7fe-c1f30b966d67 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: e95f5fca-3e9f-4b8a-939a-110a184fc0b0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:49:27.587237 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d947cfce-d823-4ffe-a7fe-c1f30b966d67 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:27.587723 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d947cfce-d823-4ffe-a7fe-c1f30b966d67 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:27.588593 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d947cfce-d823-4ffe-a7fe-c1f30b966d67 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:27.589039 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d947cfce-d823-4ffe-a7fe-c1f30b966d67 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:27.668110 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d947cfce-d823-4ffe-a7fe-c1f30b966d67 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:49:27.677100 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d947cfce-d823-4ffe-a7fe-c1f30b966d67 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0" status: 200 len: 1223 microversion: 2.1 time: 0.102775 Jun 17 11:49:27.677778 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 492/986] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:49:27 2022] GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0 => generated 1223 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:49:28.695866 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-36e694df-d53b-4534-a363-92a051643a31 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:28.696554 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-36e694df-d53b-4534-a363-92a051643a31 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: e95f5fca-3e9f-4b8a-939a-110a184fc0b0] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:49:28.704743 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-36e694df-d53b-4534-a363-92a051643a31 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:28.710343 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-36e694df-d53b-4534-a363-92a051643a31 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:28.710343 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-36e694df-d53b-4534-a363-92a051643a31 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:28.710343 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-36e694df-d53b-4534-a363-92a051643a31 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:28.776242 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-36e694df-d53b-4534-a363-92a051643a31 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:49:28.791841 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-36e694df-d53b-4534-a363-92a051643a31 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0" status: 200 len: 1271 microversion: 2.1 time: 0.100367 Jun 17 11:49:28.792452 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 495/987] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:49:28 2022] GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0 => generated 1271 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:49:29.812862 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-012bdfae-8f31-4864-b571-14c0d48e1062 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:29.814704 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-012bdfae-8f31-4864-b571-14c0d48e1062 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: e95f5fca-3e9f-4b8a-939a-110a184fc0b0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:49:29.821784 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-012bdfae-8f31-4864-b571-14c0d48e1062 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:29.822529 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-012bdfae-8f31-4864-b571-14c0d48e1062 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:29.823322 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-012bdfae-8f31-4864-b571-14c0d48e1062 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:29.823966 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-012bdfae-8f31-4864-b571-14c0d48e1062 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:29.977513 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-012bdfae-8f31-4864-b571-14c0d48e1062 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:49:29.986252 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-012bdfae-8f31-4864-b571-14c0d48e1062 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0" status: 200 len: 1319 microversion: 2.1 time: 0.180514 Jun 17 11:49:29.987690 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 493/988] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:49:29 2022] GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:49:30.912831 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-8b8d5213-6a74-4e36-812f-f894ad0583f4 req-47a6b4ab-7538-4721-b448-f3ad37803493 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e95f5fca-3e9f-4b8a-939a-110a184fc0b0", "tag": "4b5567c6-cd2b-45dd-9ccf-39483a6a6ac2"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:49:30.923357 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-8b8d5213-6a74-4e36-812f-f894ad0583f4 req-47a6b4ab-7538-4721-b448-f3ad37803493 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:30.926300 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-8b8d5213-6a74-4e36-812f-f894ad0583f4 req-47a6b4ab-7538-4721-b448-f3ad37803493 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:30.939817 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=77 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:49:30.942103 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-8b8d5213-6a74-4e36-812f-f894ad0583f4 req-47a6b4ab-7538-4721-b448-f3ad37803493 service nova] Creating event network-changed:4b5567c6-cd2b-45dd-9ccf-39483a6a6ac2 for instance e95f5fca-3e9f-4b8a-939a-110a184fc0b0 on hv-cinder-83716 Jun 17 11:49:30.948228 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-8b8d5213-6a74-4e36-812f-f894ad0583f4 req-47a6b4ab-7538-4721-b448-f3ad37803493 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041739 Jun 17 11:49:30.948967 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 496/989] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:49:31.005241 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-0ef53b64-c55a-4d4a-bce2-90f67d37dba0 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:31.005859 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-0ef53b64-c55a-4d4a-bce2-90f67d37dba0 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: e95f5fca-3e9f-4b8a-939a-110a184fc0b0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:49:31.018071 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0ef53b64-c55a-4d4a-bce2-90f67d37dba0 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:31.018071 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0ef53b64-c55a-4d4a-bce2-90f67d37dba0 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:31.018071 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0ef53b64-c55a-4d4a-bce2-90f67d37dba0 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:31.018071 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0ef53b64-c55a-4d4a-bce2-90f67d37dba0 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:31.187740 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-0ef53b64-c55a-4d4a-bce2-90f67d37dba0 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:49:31.197417 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-0ef53b64-c55a-4d4a-bce2-90f67d37dba0 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0" status: 200 len: 1319 microversion: 2.1 time: 0.197039 Jun 17 11:49:31.207399 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 494/990] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:49:30 2022] GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0 => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:49:32.216774 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8b0650ca-3bd7-4cb2-9202-c8c3a9964e1e tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:32.217549 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-8b0650ca-3bd7-4cb2-9202-c8c3a9964e1e tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: e95f5fca-3e9f-4b8a-939a-110a184fc0b0] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:49:32.224533 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8b0650ca-3bd7-4cb2-9202-c8c3a9964e1e tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:32.224991 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8b0650ca-3bd7-4cb2-9202-c8c3a9964e1e tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:32.225760 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8b0650ca-3bd7-4cb2-9202-c8c3a9964e1e tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:32.226197 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8b0650ca-3bd7-4cb2-9202-c8c3a9964e1e tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:32.389609 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-8b0650ca-3bd7-4cb2-9202-c8c3a9964e1e tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:49:32.402816 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-8b0650ca-3bd7-4cb2-9202-c8c3a9964e1e tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0" status: 200 len: 1319 microversion: 2.1 time: 0.189193 Jun 17 11:49:32.402816 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 497/991] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:49:32 2022] GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:49:33.418364 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-63afc921-a7af-4968-b628-cc559b4cd515 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:33.418979 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-63afc921-a7af-4968-b628-cc559b4cd515 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: e95f5fca-3e9f-4b8a-939a-110a184fc0b0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:49:33.425521 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-63afc921-a7af-4968-b628-cc559b4cd515 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:33.425964 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-63afc921-a7af-4968-b628-cc559b4cd515 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:33.426733 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-63afc921-a7af-4968-b628-cc559b4cd515 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:33.427169 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-63afc921-a7af-4968-b628-cc559b4cd515 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:33.570536 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-63afc921-a7af-4968-b628-cc559b4cd515 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:49:33.578221 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-63afc921-a7af-4968-b628-cc559b4cd515 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0" status: 200 len: 1319 microversion: 2.1 time: 0.163810 Jun 17 11:49:33.578827 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 495/992] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:49:33 2022] GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:49:34.595275 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b74290e4-78d4-4651-b7ec-792c61caf34b tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:34.595914 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b74290e4-78d4-4651-b7ec-792c61caf34b tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: e95f5fca-3e9f-4b8a-939a-110a184fc0b0] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:49:34.603493 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b74290e4-78d4-4651-b7ec-792c61caf34b tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:34.603941 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b74290e4-78d4-4651-b7ec-792c61caf34b tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:34.604722 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b74290e4-78d4-4651-b7ec-792c61caf34b tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:34.605153 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b74290e4-78d4-4651-b7ec-792c61caf34b tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:34.752700 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b74290e4-78d4-4651-b7ec-792c61caf34b tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:49:34.763329 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b74290e4-78d4-4651-b7ec-792c61caf34b tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0" status: 200 len: 1319 microversion: 2.1 time: 0.171830 Jun 17 11:49:34.764239 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 498/993] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:49:34 2022] GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:49:35.780823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4648b29e-fbc2-4ced-aa40-9030766fdd1f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:35.781511 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4648b29e-fbc2-4ced-aa40-9030766fdd1f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: e95f5fca-3e9f-4b8a-939a-110a184fc0b0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:49:35.784043 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=2 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:49:35.784710 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=36 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:49:35.790936 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4648b29e-fbc2-4ced-aa40-9030766fdd1f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:35.791393 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4648b29e-fbc2-4ced-aa40-9030766fdd1f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:35.792193 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4648b29e-fbc2-4ced-aa40-9030766fdd1f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:35.792625 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4648b29e-fbc2-4ced-aa40-9030766fdd1f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:35.929986 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4648b29e-fbc2-4ced-aa40-9030766fdd1f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:49:35.938160 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4648b29e-fbc2-4ced-aa40-9030766fdd1f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0" status: 200 len: 1319 microversion: 2.1 time: 0.161335 Jun 17 11:49:35.943505 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 496/994] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:49:35 2022] GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:49:36.220066 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-fa72ac4f-bca8-40c3-82fc-b57349e63398 req-35a7984b-0d64-486b-aa17-30bbb69485b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e95f5fca-3e9f-4b8a-939a-110a184fc0b0", "name": "network-vif-plugged", "status": "completed", "tag": "4b5567c6-cd2b-45dd-9ccf-39483a6a6ac2"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:49:36.225382 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:49:36.226569 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:49:36.230603 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-fa72ac4f-bca8-40c3-82fc-b57349e63398 req-35a7984b-0d64-486b-aa17-30bbb69485b5 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:36.231053 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-fa72ac4f-bca8-40c3-82fc-b57349e63398 req-35a7984b-0d64-486b-aa17-30bbb69485b5 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:36.244250 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-fa72ac4f-bca8-40c3-82fc-b57349e63398 req-35a7984b-0d64-486b-aa17-30bbb69485b5 service nova] Creating event network-vif-plugged:4b5567c6-cd2b-45dd-9ccf-39483a6a6ac2 for instance e95f5fca-3e9f-4b8a-939a-110a184fc0b0 on hv-cinder-83716 Jun 17 11:49:36.249194 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-fa72ac4f-bca8-40c3-82fc-b57349e63398 req-35a7984b-0d64-486b-aa17-30bbb69485b5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033340 Jun 17 11:49:36.249816 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 499/995] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:49:36.956823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2fb4df3b-ac54-4c42-bd20-997883e8f228 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:36.957372 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-2fb4df3b-ac54-4c42-bd20-997883e8f228 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: e95f5fca-3e9f-4b8a-939a-110a184fc0b0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:49:36.964492 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2fb4df3b-ac54-4c42-bd20-997883e8f228 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:36.964946 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2fb4df3b-ac54-4c42-bd20-997883e8f228 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:36.965732 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2fb4df3b-ac54-4c42-bd20-997883e8f228 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:36.966175 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2fb4df3b-ac54-4c42-bd20-997883e8f228 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:37.110456 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2fb4df3b-ac54-4c42-bd20-997883e8f228 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:49:37.120031 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2fb4df3b-ac54-4c42-bd20-997883e8f228 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0" status: 200 len: 1319 microversion: 2.1 time: 0.167159 Jun 17 11:49:37.120902 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 497/996] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:49:36 2022] GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:49:38.135778 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=8 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:49:38.141328 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-33629306-f109-4ebf-8d88-c641f7b7507a tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:38.142239 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-33629306-f109-4ebf-8d88-c641f7b7507a tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: e95f5fca-3e9f-4b8a-939a-110a184fc0b0] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:49:38.158575 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-33629306-f109-4ebf-8d88-c641f7b7507a tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:38.158575 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-33629306-f109-4ebf-8d88-c641f7b7507a tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:38.158575 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-33629306-f109-4ebf-8d88-c641f7b7507a tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:38.158575 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-33629306-f109-4ebf-8d88-c641f7b7507a tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:38.297908 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-33629306-f109-4ebf-8d88-c641f7b7507a tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:49:38.306370 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-33629306-f109-4ebf-8d88-c641f7b7507a tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0" status: 200 len: 1319 microversion: 2.1 time: 0.171775 Jun 17 11:49:38.306950 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 500/997] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:49:38 2022] GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:49:39.323578 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-76b8eb15-0eae-4ed8-a5f1-d90ceb470d44 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:49:39.324186 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-76b8eb15-0eae-4ed8-a5f1-d90ceb470d44 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: e95f5fca-3e9f-4b8a-939a-110a184fc0b0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:49:39.334170 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-76b8eb15-0eae-4ed8-a5f1-d90ceb470d44 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:39.334170 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-76b8eb15-0eae-4ed8-a5f1-d90ceb470d44 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:39.334170 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-76b8eb15-0eae-4ed8-a5f1-d90ceb470d44 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:49:39.334170 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-76b8eb15-0eae-4ed8-a5f1-d90ceb470d44 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:49:39.472881 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-76b8eb15-0eae-4ed8-a5f1-d90ceb470d44 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:49:39.481644 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-76b8eb15-0eae-4ed8-a5f1-d90ceb470d44 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0" status: 200 len: 1509 microversion: 2.1 time: 0.161803 Jun 17 11:49:39.482447 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 498/998] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:49:39 2022] GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0 => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:50:00.420942 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-726673e3-bded-4b98-840e-8ed076c6b72b tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d131ce6-2e71-4f9e-bff0-64de847091d7", "device": "/dev/sdb"}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:50:00.422555 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-726673e3-bded-4b98-840e-8ed076c6b72b tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: e95f5fca-3e9f-4b8a-939a-110a184fc0b0] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:50:00.426540 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=21 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:50:00.431874 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-726673e3-bded-4b98-840e-8ed076c6b72b tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:00.431874 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-726673e3-bded-4b98-840e-8ed076c6b72b tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:00.432597 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-726673e3-bded-4b98-840e-8ed076c6b72b tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:00.433076 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-726673e3-bded-4b98-840e-8ed076c6b72b tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:01.283254 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-726673e3-bded-4b98-840e-8ed076c6b72b tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "POST /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.866416 Jun 17 11:50:01.284239 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 501/999] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jun 17 11:50:00 2022] POST /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0/os-volume_attachments => generated 194 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:50:17.289990 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 11:50:17.290602 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Fri Jun 17 11:50:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 11:50:29.196238 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e458a203-9f78-4729-a888-668c4369b615 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:50:29.197031 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e458a203-9f78-4729-a888-668c4369b615 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: e95f5fca-3e9f-4b8a-939a-110a184fc0b0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:50:29.199814 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=5 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:50:29.200415 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=64 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:50:29.205535 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e458a203-9f78-4729-a888-668c4369b615 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:29.205982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e458a203-9f78-4729-a888-668c4369b615 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:29.206755 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e458a203-9f78-4729-a888-668c4369b615 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:29.207192 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e458a203-9f78-4729-a888-668c4369b615 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:29.314657 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-e458a203-9f78-4729-a888-668c4369b615 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lazy-loading 'services' on Instance uuid e95f5fca-3e9f-4b8a-939a-110a184fc0b0 {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:50:29.625425 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e458a203-9f78-4729-a888-668c4369b615 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0/os-volume_attachments/0d131ce6-2e71-4f9e-bff0-64de847091d7" status: 202 len: 0 microversion: 2.1 time: 0.432843 Jun 17 11:50:29.626538 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 499/1000] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Jun 17 11:50:29 2022] DELETE /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0/os-volume_attachments/0d131ce6-2e71-4f9e-bff0-64de847091d7 => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 11:50:31.812293 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=5 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:50:31.813197 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:50:31.817279 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-3c991eb4-fbed-49b2-a158-a3c94e434d01 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:50:31.817905 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-3c991eb4-fbed-49b2-a158-a3c94e434d01 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: e95f5fca-3e9f-4b8a-939a-110a184fc0b0] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:50:31.824951 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3c991eb4-fbed-49b2-a158-a3c94e434d01 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:31.829162 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3c991eb4-fbed-49b2-a158-a3c94e434d01 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:31.829162 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3c991eb4-fbed-49b2-a158-a3c94e434d01 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:31.829162 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3c991eb4-fbed-49b2-a158-a3c94e434d01 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:31.854182 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-3c991eb4-fbed-49b2-a158-a3c94e434d01 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: e95f5fca-3e9f-4b8a-939a-110a184fc0b0] Going to try to terminate instance {{(pid=124845) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 11:50:32.289358 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-3c991eb4-fbed-49b2-a158-a3c94e434d01 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0" status: 204 len: 0 microversion: 2.1 time: 0.478362 Jun 17 11:50:32.290102 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 502/1001] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 17 11:50:31 2022] DELETE /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 11:50:32.300364 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-822bef6a-00df-4a2a-94d9-4a6ce89920ee tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:50:32.301180 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-822bef6a-00df-4a2a-94d9-4a6ce89920ee tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: e95f5fca-3e9f-4b8a-939a-110a184fc0b0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:50:32.308950 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-822bef6a-00df-4a2a-94d9-4a6ce89920ee tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:32.309362 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-822bef6a-00df-4a2a-94d9-4a6ce89920ee tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:32.310301 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-822bef6a-00df-4a2a-94d9-4a6ce89920ee tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:32.310741 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-822bef6a-00df-4a2a-94d9-4a6ce89920ee tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:32.461075 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-822bef6a-00df-4a2a-94d9-4a6ce89920ee tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:50:32.470544 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-822bef6a-00df-4a2a-94d9-4a6ce89920ee tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0" status: 200 len: 1515 microversion: 2.1 time: 0.175084 Jun 17 11:50:32.471175 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 500/1002] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:50:32 2022] GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0 => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:50:33.488900 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-abefdd43-ad9a-425b-b2ae-e722769dcc3e tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:50:33.489597 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-abefdd43-ad9a-425b-b2ae-e722769dcc3e tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: e95f5fca-3e9f-4b8a-939a-110a184fc0b0] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:50:33.497215 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-abefdd43-ad9a-425b-b2ae-e722769dcc3e tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:33.497659 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-abefdd43-ad9a-425b-b2ae-e722769dcc3e tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:33.498632 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-abefdd43-ad9a-425b-b2ae-e722769dcc3e tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:33.499065 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-abefdd43-ad9a-425b-b2ae-e722769dcc3e tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:33.661903 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-abefdd43-ad9a-425b-b2ae-e722769dcc3e tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:50:33.668858 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-abefdd43-ad9a-425b-b2ae-e722769dcc3e tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0" status: 200 len: 1515 microversion: 2.1 time: 0.184467 Jun 17 11:50:33.669638 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 503/1003] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:50:33 2022] GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0 => generated 1515 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:50:34.688785 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3019f14a-a3af-40ba-8f96-e25ca829d51a tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:50:34.694401 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-3019f14a-a3af-40ba-8f96-e25ca829d51a tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: e95f5fca-3e9f-4b8a-939a-110a184fc0b0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:50:34.721654 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3019f14a-a3af-40ba-8f96-e25ca829d51a tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:34.723929 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3019f14a-a3af-40ba-8f96-e25ca829d51a tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:34.727650 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3019f14a-a3af-40ba-8f96-e25ca829d51a tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:34.729088 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3019f14a-a3af-40ba-8f96-e25ca829d51a tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:34.806134 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-f3320036-9dd8-4530-ae80-0fe0af5a76c7 req-33e6d899-5519-4f2e-8638-7e25191e6438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e95f5fca-3e9f-4b8a-939a-110a184fc0b0", "name": "network-vif-deleted", "tag": "4b5567c6-cd2b-45dd-9ccf-39483a6a6ac2"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:50:34.817660 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-f3320036-9dd8-4530-ae80-0fe0af5a76c7 req-33e6d899-5519-4f2e-8638-7e25191e6438 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:34.818198 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-f3320036-9dd8-4530-ae80-0fe0af5a76c7 req-33e6d899-5519-4f2e-8638-7e25191e6438 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:34.832559 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3019f14a-a3af-40ba-8f96-e25ca829d51a tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:50:34.833424 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-f3320036-9dd8-4530-ae80-0fe0af5a76c7 req-33e6d899-5519-4f2e-8638-7e25191e6438 service nova] Creating event network-vif-deleted:4b5567c6-cd2b-45dd-9ccf-39483a6a6ac2 for instance e95f5fca-3e9f-4b8a-939a-110a184fc0b0 on hv-cinder-83716 Jun 17 11:50:34.839682 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-f3320036-9dd8-4530-ae80-0fe0af5a76c7 req-33e6d899-5519-4f2e-8638-7e25191e6438 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039462 Jun 17 11:50:34.840774 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 504/1004] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:50:34.841387 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-3019f14a-a3af-40ba-8f96-e25ca829d51a tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0" status: 200 len: 1473 microversion: 2.1 time: 0.158563 Jun 17 11:50:34.844770 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 501/1005] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:50:34 2022] GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0 => generated 1473 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:50:35.858634 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e4fd3e56-c746-43bd-8a7b-32d25cc46a02 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:50:35.860329 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-e4fd3e56-c746-43bd-8a7b-32d25cc46a02 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: e95f5fca-3e9f-4b8a-939a-110a184fc0b0] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:50:35.878834 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e4fd3e56-c746-43bd-8a7b-32d25cc46a02 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:35.879288 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e4fd3e56-c746-43bd-8a7b-32d25cc46a02 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:35.880106 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e4fd3e56-c746-43bd-8a7b-32d25cc46a02 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:35.880557 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e4fd3e56-c746-43bd-8a7b-32d25cc46a02 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:35.925891 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e4fd3e56-c746-43bd-8a7b-32d25cc46a02 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:35.926330 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e4fd3e56-c746-43bd-8a7b-32d25cc46a02 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:35.926876 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-e4fd3e56-c746-43bd-8a7b-32d25cc46a02 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lazy-loading 'fault' on Instance uuid e95f5fca-3e9f-4b8a-939a-110a184fc0b0 {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:50:35.971649 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-e4fd3e56-c746-43bd-8a7b-32d25cc46a02 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:50:35.979066 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-e4fd3e56-c746-43bd-8a7b-32d25cc46a02 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0" status: 200 len: 1309 microversion: 2.1 time: 0.124677 Jun 17 11:50:35.980265 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 505/1006] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:50:35 2022] GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0 => generated 1309 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:50:37.000613 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3209b51a-3179-4aaf-96e8-0f7be1473f50 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:50:37.005676 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-3209b51a-3179-4aaf-96e8-0f7be1473f50 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: e95f5fca-3e9f-4b8a-939a-110a184fc0b0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:50:37.009225 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3209b51a-3179-4aaf-96e8-0f7be1473f50 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:37.009729 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3209b51a-3179-4aaf-96e8-0f7be1473f50 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:37.010544 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3209b51a-3179-4aaf-96e8-0f7be1473f50 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:37.011835 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3209b51a-3179-4aaf-96e8-0f7be1473f50 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:37.028983 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-3209b51a-3179-4aaf-96e8-0f7be1473f50 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] HTTP exception thrown: Instance e95f5fca-3e9f-4b8a-939a-110a184fc0b0 could not be found. Jun 17 11:50:37.030745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3209b51a-3179-4aaf-96e8-0f7be1473f50 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Request method failure captured: Jun 17 11:50:37.030745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: request: GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0 HTTP/1.1 Jun 17 11:50:37.030745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept: application/json Jun 17 11:50:37.030745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jun 17 11:50:37.030745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Connection: close Jun 17 11:50:37.030745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jun 17 11:50:37.030745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jun 17 11:50:37.030745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Host: 10.222.0.45 Jun 17 11:50:37.030745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jun 17 11:50:37.030745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jun 17 11:50:37.030745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABirGpCGaDb67K2rFXXXI1y3u9xx4GNB9MHBbgJZ8gj1_SL38lw9IBaJrITSDqaUp-Y_xeGfUh18yADf61kBUJbIKGXgH9GG6mBe1jT2JiSuKvN675ZqrYF7eb9AkYWq8vzXHh1v6o776lCEdE1gg8DBw25llJaRP3V_nm7LtpSZc4S25I Jun 17 11:50:37.030745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jun 17 11:50:37.030745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jun 17 11:50:37.030745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jun 17 11:50:37.030745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jun 17 11:50:37.030745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jun 17 11:50:37.030745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jun 17 11:50:37.030745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Id: eab294243e474e34a2c6eec07747bf0d Jun 17 11:50:37.030745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-VolumesSnapshotTestJSON-240803090 Jun 17 11:50:37.030745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Role: member,reader Jun 17 11:50:37.030745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Roles: member,reader Jun 17 11:50:37.032451 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/eab294243e474e34a2c6eec07747bf0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_eab294243e474e34a2c6eec07747bf0d", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eab294243e474e34a2c6eec07747bf0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eab294243e474e34a2c6eec07747bf0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:50:37.032451 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-VolumesSnapshotTestJSON-240803090 Jun 17 11:50:37.032451 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Id: eab294243e474e34a2c6eec07747bf0d Jun 17 11:50:37.032451 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-240803090 Jun 17 11:50:37.032451 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User: tempest-VolumesSnapshotTestJSON-240803090-project Jun 17 11:50:37.032451 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jun 17 11:50:37.032451 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jun 17 11:50:37.032451 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Id: fdbcf7bbf6ef4e9a9a1e7ab5802ce12d Jun 17 11:50:37.032451 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-VolumesSnapshotTestJSON-240803090-project Jun 17 11:50:37.032451 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: method: > Jun 17 11:50:37.032451 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: exception: Instance e95f5fca-3e9f-4b8a-939a-110a184fc0b0 could not be found. Jun 17 11:50:37.032451 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: action_args: {'id': 'e95f5fca-3e9f-4b8a-939a-110a184fc0b0'} Jun 17 11:50:37.045816 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:50:37.045816 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:50:37.045816 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:50:37.045816 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:50:37.045816 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:50:37.045816 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:50:37.045816 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:50:37.045816 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:50:37.045816 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:50:37.045816 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:50:37.045816 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e95f5fca-3e9f-4b8a-939a-110a184fc0b0 could not be found. Jun 17 11:50:37.045816 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:50:37.045816 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:50:37.045816 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:50:37.045816 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:50:37.045816 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:50:37.045816 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:50:37.045816 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:50:37.045816 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:50:37.045816 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:50:37.047638 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:50:37.047638 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 11:50:37.047638 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 11:50:37.047638 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:50:37.047638 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:50:37.047638 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:50:37.047638 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:50:37.047638 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e95f5fca-3e9f-4b8a-939a-110a184fc0b0 could not be found. Jun 17 11:50:37.047638 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:50:37.047638 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:50:37.047638 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:50:37.047638 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:50:37.047638 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:50:37.047638 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:50:37.047638 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:50:37.047638 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:50:37.047638 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e95f5fca-3e9f-4b8a-939a-110a184fc0b0 could not be found. Jun 17 11:50:37.047638 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:50:37.048812 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3209b51a-3179-4aaf-96e8-0f7be1473f50 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Returning 404 to user: Instance e95f5fca-3e9f-4b8a-939a-110a184fc0b0 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:50:37.048812 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-3209b51a-3179-4aaf-96e8-0f7be1473f50 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0" status: 404 len: 111 microversion: 2.1 time: 0.035816 Jun 17 11:50:37.048812 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 502/1007] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:50:36 2022] GET /compute/v2.1/servers/e95f5fca-3e9f-4b8a-939a-110a184fc0b0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:50:47.906083 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f09e4d52-caef-4401-b7c3-565f60a4f370 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-995269868", "imageRef": "272eb2b7-ddf0-433f-8be8-cdc13c01be77", "flavorRef": "452", "networks": [{"uuid": "48b15f3b-e7e5-459b-b54f-217e63bb1295"}]}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:50:47.914734 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:50:47.915922 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:50:47.992309 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.network.neutron [None req-f09e4d52-caef-4401-b7c3-565f60a4f370 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] validate_networks() for [('48b15f3b-e7e5-459b-b54f-217e63bb1295', None, None, None, None, None)] {{(pid=124845) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 11:50:48.416077 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-f09e4d52-caef-4401-b7c3-565f60a4f370 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Flavor limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 11:50:48.416506 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-f09e4d52-caef-4401-b7c3-565f60a4f370 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Image limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 11:50:48.418295 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-f09e4d52-caef-4401-b7c3-565f60a4f370 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Flavor pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 11:50:48.418610 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-f09e4d52-caef-4401-b7c3-565f60a4f370 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Image pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 11:50:48.419059 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-f09e4d52-caef-4401-b7c3-565f60a4f370 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 11:50:48.430046 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f09e4d52-caef-4401-b7c3-565f60a4f370 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:48.430046 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f09e4d52-caef-4401-b7c3-565f60a4f370 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:48.430403 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f09e4d52-caef-4401-b7c3-565f60a4f370 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:48.430669 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f09e4d52-caef-4401-b7c3-565f60a4f370 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:48.449726 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-f09e4d52-caef-4401-b7c3-565f60a4f370 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Getting quotas for project eab294243e474e34a2c6eec07747bf0d. Resources: {'instances', 'ram', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 11:50:48.454737 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-f09e4d52-caef-4401-b7c3-565f60a4f370 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Getting quotas for user fdbcf7bbf6ef4e9a9a1e7ab5802ce12d and project eab294243e474e34a2c6eec07747bf0d. Resources: {'instances', 'ram', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 11:50:48.468092 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f09e4d52-caef-4401-b7c3-565f60a4f370 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Going to run 1 instances... {{(pid=124845) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 11:50:48.471166 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f09e4d52-caef-4401-b7c3-565f60a4f370 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: b7e77bad-d147-495b-99e0-51905dd4860f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='272eb2b7-ddf0-433f-8be8-cdc13c01be77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 11:50:48.600338 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f09e4d52-caef-4401-b7c3-565f60a4f370 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.704917 Jun 17 11:50:48.601000 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 506/1008] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 17 11:50:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 11:50:48.618765 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d843d76b-9b68-4ed0-af27-e1486bb7073d tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:50:48.619886 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d843d76b-9b68-4ed0-af27-e1486bb7073d tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: b7e77bad-d147-495b-99e0-51905dd4860f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:50:48.623572 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=8 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:50:48.624295 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:50:48.689970 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d843d76b-9b68-4ed0-af27-e1486bb7073d tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:50:48.700805 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d843d76b-9b68-4ed0-af27-e1486bb7073d tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f" status: 200 len: 1218 microversion: 2.1 time: 0.088979 Jun 17 11:50:48.701386 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 503/1009] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:50:48 2022] GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:50:49.718365 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2438e9c3-56cc-4085-92d2-236dc2c8152f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:50:49.718979 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2438e9c3-56cc-4085-92d2-236dc2c8152f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: b7e77bad-d147-495b-99e0-51905dd4860f] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:50:49.726889 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2438e9c3-56cc-4085-92d2-236dc2c8152f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:49.727344 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2438e9c3-56cc-4085-92d2-236dc2c8152f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:49.728154 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2438e9c3-56cc-4085-92d2-236dc2c8152f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:49.728595 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2438e9c3-56cc-4085-92d2-236dc2c8152f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:49.802688 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2438e9c3-56cc-4085-92d2-236dc2c8152f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:50:49.811017 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2438e9c3-56cc-4085-92d2-236dc2c8152f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f" status: 200 len: 1222 microversion: 2.1 time: 0.097488 Jun 17 11:50:49.811651 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 507/1010] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:50:49 2022] GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:50:50.830588 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-da2e37c1-ec0b-40c8-8b75-2fde06a3626f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:50:50.831453 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-da2e37c1-ec0b-40c8-8b75-2fde06a3626f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: b7e77bad-d147-495b-99e0-51905dd4860f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:50:50.841150 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-da2e37c1-ec0b-40c8-8b75-2fde06a3626f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:50.841652 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-da2e37c1-ec0b-40c8-8b75-2fde06a3626f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:50.842459 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-da2e37c1-ec0b-40c8-8b75-2fde06a3626f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:50.842894 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-da2e37c1-ec0b-40c8-8b75-2fde06a3626f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:50.918589 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-da2e37c1-ec0b-40c8-8b75-2fde06a3626f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:50:50.927244 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-da2e37c1-ec0b-40c8-8b75-2fde06a3626f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f" status: 200 len: 1270 microversion: 2.1 time: 0.102405 Jun 17 11:50:50.927947 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 504/1011] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:50:50 2022] GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f => generated 1270 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:50:51.949089 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-bdbff90f-a04f-4d5c-b350-9c45c0587f9a tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:50:51.949969 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-bdbff90f-a04f-4d5c-b350-9c45c0587f9a tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: b7e77bad-d147-495b-99e0-51905dd4860f] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:50:51.962386 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bdbff90f-a04f-4d5c-b350-9c45c0587f9a tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:51.963299 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bdbff90f-a04f-4d5c-b350-9c45c0587f9a tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:51.965648 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bdbff90f-a04f-4d5c-b350-9c45c0587f9a tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:51.966403 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bdbff90f-a04f-4d5c-b350-9c45c0587f9a tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:52.068694 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-bdbff90f-a04f-4d5c-b350-9c45c0587f9a tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:50:52.078832 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-bdbff90f-a04f-4d5c-b350-9c45c0587f9a tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f" status: 200 len: 1276 microversion: 2.1 time: 0.136985 Jun 17 11:50:52.081618 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 508/1012] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:50:51 2022] GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:50:53.097253 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f43d86e1-a2ae-4852-a586-db1a7cdf9486 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:50:53.098381 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f43d86e1-a2ae-4852-a586-db1a7cdf9486 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: b7e77bad-d147-495b-99e0-51905dd4860f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:50:53.106273 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f43d86e1-a2ae-4852-a586-db1a7cdf9486 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:53.106978 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f43d86e1-a2ae-4852-a586-db1a7cdf9486 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:53.107965 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f43d86e1-a2ae-4852-a586-db1a7cdf9486 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:53.108561 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f43d86e1-a2ae-4852-a586-db1a7cdf9486 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:53.407238 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a60c517a-28ad-447d-a873-0bc498883273 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:50:53.408471 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a60c517a-28ad-447d-a873-0bc498883273 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:50:53.415720 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a60c517a-28ad-447d-a873-0bc498883273 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:53.416615 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a60c517a-28ad-447d-a873-0bc498883273 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:53.417698 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a60c517a-28ad-447d-a873-0bc498883273 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:53.418253 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a60c517a-28ad-447d-a873-0bc498883273 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:53.477498 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a60c517a-28ad-447d-a873-0bc498883273 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Going to try to terminate instance {{(pid=124845) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 11:50:53.718951 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f43d86e1-a2ae-4852-a586-db1a7cdf9486 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:50:53.726803 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f43d86e1-a2ae-4852-a586-db1a7cdf9486 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f" status: 200 len: 1318 microversion: 2.1 time: 0.633954 Jun 17 11:50:53.727692 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 505/1013] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:50:53 2022] GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f => generated 1318 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:50:53.733005 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-a7089312-adef-4fa1-afd0-d4f25986df56 req-3901e3ba-037b-418a-b769-73c87651ba31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef2e4aca-bc09-41dd-9f63-3a8649cf871c", "tag": "0b44766a-48d1-49bc-a348-b25e0252287f"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:50:53.741719 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-a7089312-adef-4fa1-afd0-d4f25986df56 req-3901e3ba-037b-418a-b769-73c87651ba31 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:53.742504 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-a7089312-adef-4fa1-afd0-d4f25986df56 req-3901e3ba-037b-418a-b769-73c87651ba31 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:53.754797 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-a7089312-adef-4fa1-afd0-d4f25986df56 req-3901e3ba-037b-418a-b769-73c87651ba31 service nova] Creating event network-changed:0b44766a-48d1-49bc-a348-b25e0252287f for instance ef2e4aca-bc09-41dd-9f63-3a8649cf871c on hv-cinder-83716 Jun 17 11:50:53.760000 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-a7089312-adef-4fa1-afd0-d4f25986df56 req-3901e3ba-037b-418a-b769-73c87651ba31 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030962 Jun 17 11:50:53.761131 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 506/1014] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:50:54.177837 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-3162287b-9d36-467c-b94b-1a19fe030e0c req-90e856ee-db44-4b94-b19a-482423b14a38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7e77bad-d147-495b-99e0-51905dd4860f", "tag": "a033126a-b60e-4ebe-84b3-e71d2dc8d449"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:50:54.199008 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-3162287b-9d36-467c-b94b-1a19fe030e0c req-90e856ee-db44-4b94-b19a-482423b14a38 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:54.200277 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-3162287b-9d36-467c-b94b-1a19fe030e0c req-90e856ee-db44-4b94-b19a-482423b14a38 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:54.241158 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-3162287b-9d36-467c-b94b-1a19fe030e0c req-90e856ee-db44-4b94-b19a-482423b14a38 service nova] Creating event network-changed:a033126a-b60e-4ebe-84b3-e71d2dc8d449 for instance b7e77bad-d147-495b-99e0-51905dd4860f on hv-cinder-83716 Jun 17 11:50:54.255503 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-3162287b-9d36-467c-b94b-1a19fe030e0c req-90e856ee-db44-4b94-b19a-482423b14a38 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082999 Jun 17 11:50:54.256298 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 507/1015] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:50:54.470944 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a60c517a-28ad-447d-a873-0bc498883273 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 204 len: 0 microversion: 2.1 time: 1.067760 Jun 17 11:50:54.475142 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 509/1016] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 17 11:50:53 2022] DELETE /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 0 bytes in 1074 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 17 11:50:54.492740 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-dcdea661-c9b8-44a7-bdf3-30873618fb8d tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:50:54.494307 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-dcdea661-c9b8-44a7-bdf3-30873618fb8d tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:50:54.540990 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dcdea661-c9b8-44a7-bdf3-30873618fb8d tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:54.543283 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dcdea661-c9b8-44a7-bdf3-30873618fb8d tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:54.559548 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dcdea661-c9b8-44a7-bdf3-30873618fb8d tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:54.560697 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dcdea661-c9b8-44a7-bdf3-30873618fb8d tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:54.747646 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f8705bbf-69e1-4d23-93bf-fe1d884c0cf4 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:50:54.748658 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f8705bbf-69e1-4d23-93bf-fe1d884c0cf4 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: b7e77bad-d147-495b-99e0-51905dd4860f] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:50:54.760986 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f8705bbf-69e1-4d23-93bf-fe1d884c0cf4 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:54.766027 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f8705bbf-69e1-4d23-93bf-fe1d884c0cf4 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:54.767493 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f8705bbf-69e1-4d23-93bf-fe1d884c0cf4 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:54.768108 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f8705bbf-69e1-4d23-93bf-fe1d884c0cf4 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:54.792545 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-dcdea661-c9b8-44a7-bdf3-30873618fb8d tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:50:54.846274 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-dcdea661-c9b8-44a7-bdf3-30873618fb8d tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1566 microversion: 2.1 time: 0.361939 Jun 17 11:50:54.852565 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 508/1017] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:50:54 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1566 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:50:54.956070 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f8705bbf-69e1-4d23-93bf-fe1d884c0cf4 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:50:54.965984 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f8705bbf-69e1-4d23-93bf-fe1d884c0cf4 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f" status: 200 len: 1318 microversion: 2.1 time: 0.225346 Jun 17 11:50:54.966791 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 510/1018] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:50:54 2022] GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:50:55.870884 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5630b296-51e9-4b64-93f7-8cb1b55109e0 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:50:55.886761 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-5630b296-51e9-4b64-93f7-8cb1b55109e0 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:50:55.886761 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5630b296-51e9-4b64-93f7-8cb1b55109e0 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:55.886761 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5630b296-51e9-4b64-93f7-8cb1b55109e0 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:55.886761 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5630b296-51e9-4b64-93f7-8cb1b55109e0 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:55.887393 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5630b296-51e9-4b64-93f7-8cb1b55109e0 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:55.992887 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b090431e-91bb-4b62-9a00-91b182586c35 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:50:55.993386 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b090431e-91bb-4b62-9a00-91b182586c35 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: b7e77bad-d147-495b-99e0-51905dd4860f] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:50:56.000189 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b090431e-91bb-4b62-9a00-91b182586c35 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:56.001042 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b090431e-91bb-4b62-9a00-91b182586c35 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:56.001951 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b090431e-91bb-4b62-9a00-91b182586c35 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:56.002491 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b090431e-91bb-4b62-9a00-91b182586c35 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:56.028699 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5630b296-51e9-4b64-93f7-8cb1b55109e0 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:50:56.037235 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5630b296-51e9-4b64-93f7-8cb1b55109e0 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1448 microversion: 2.1 time: 0.171324 Jun 17 11:50:56.042804 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 509/1019] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:50:55 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1448 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:50:56.417163 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b090431e-91bb-4b62-9a00-91b182586c35 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:50:56.426359 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b090431e-91bb-4b62-9a00-91b182586c35 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f" status: 200 len: 1318 microversion: 2.1 time: 0.437638 Jun 17 11:50:56.432914 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 511/1020] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:50:55 2022] GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f => generated 1318 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:50:56.648590 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a4e1803e-6174-4140-a34f-a3e781159a69 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-564157342", "imageRef": "272eb2b7-ddf0-433f-8be8-cdc13c01be77", "flavorRef": "452"}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:50:56.697653 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.network.neutron [None req-a4e1803e-6174-4140-a34f-a3e781159a69 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] validate_networks() for None {{(pid=124844) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 11:50:57.030207 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-a4e1803e-6174-4140-a34f-a3e781159a69 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Flavor limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 11:50:57.030839 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-a4e1803e-6174-4140-a34f-a3e781159a69 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Image limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 11:50:57.031099 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-a4e1803e-6174-4140-a34f-a3e781159a69 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Flavor pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 11:50:57.031561 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-a4e1803e-6174-4140-a34f-a3e781159a69 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Image pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 11:50:57.031985 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-a4e1803e-6174-4140-a34f-a3e781159a69 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 11:50:57.042285 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a4e1803e-6174-4140-a34f-a3e781159a69 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:57.044472 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a4e1803e-6174-4140-a34f-a3e781159a69 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:57.044472 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a4e1803e-6174-4140-a34f-a3e781159a69 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:57.044472 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a4e1803e-6174-4140-a34f-a3e781159a69 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:57.055760 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ad972c67-0c7e-4ff4-8b21-cb4e50613d09 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:50:57.057927 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-ad972c67-0c7e-4ff4-8b21-cb4e50613d09 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:50:57.065529 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-a4e1803e-6174-4140-a34f-a3e781159a69 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Getting quotas for project 8a12c1715a684de19bfb01894e7677ee. Resources: {'instances', 'ram', 'cores'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 11:50:57.065967 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ad972c67-0c7e-4ff4-8b21-cb4e50613d09 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:57.066840 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ad972c67-0c7e-4ff4-8b21-cb4e50613d09 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:57.068281 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ad972c67-0c7e-4ff4-8b21-cb4e50613d09 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:57.068942 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ad972c67-0c7e-4ff4-8b21-cb4e50613d09 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:57.074030 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-a4e1803e-6174-4140-a34f-a3e781159a69 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Getting quotas for user 2bd5306bf9994c53b874b7cad59f7dc1 and project 8a12c1715a684de19bfb01894e7677ee. Resources: {'instances', 'ram', 'cores'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 11:50:57.087804 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a4e1803e-6174-4140-a34f-a3e781159a69 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Going to run 1 instances... {{(pid=124844) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 11:50:57.091061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a4e1803e-6174-4140-a34f-a3e781159a69 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] [instance: 8fc9a79b-2073-43de-a138-8fd2c211fbb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='272eb2b7-ddf0-433f-8be8-cdc13c01be77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 11:50:57.161928 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ad972c67-0c7e-4ff4-8b21-cb4e50613d09 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:50:57.170125 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-ad972c67-0c7e-4ff4-8b21-cb4e50613d09 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1381 microversion: 2.1 time: 0.118608 Jun 17 11:50:57.170714 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 512/1021] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:50:57 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1381 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:50:57.175404 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-297d0c94-0ea2-4354-a130-74b354fbf2f2 req-6f8f4012-87a7-49f6-8688-f432f9311b46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef2e4aca-bc09-41dd-9f63-3a8649cf871c", "name": "network-vif-deleted", "tag": "0b44766a-48d1-49bc-a348-b25e0252287f"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:50:57.184880 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-297d0c94-0ea2-4354-a130-74b354fbf2f2 req-6f8f4012-87a7-49f6-8688-f432f9311b46 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:57.185333 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-297d0c94-0ea2-4354-a130-74b354fbf2f2 req-6f8f4012-87a7-49f6-8688-f432f9311b46 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:57.197086 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-297d0c94-0ea2-4354-a130-74b354fbf2f2 req-6f8f4012-87a7-49f6-8688-f432f9311b46 service nova] Creating event network-vif-deleted:0b44766a-48d1-49bc-a348-b25e0252287f for instance ef2e4aca-bc09-41dd-9f63-3a8649cf871c on hv-cinder-83716 Jun 17 11:50:57.203110 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-297d0c94-0ea2-4354-a130-74b354fbf2f2 req-6f8f4012-87a7-49f6-8688-f432f9311b46 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031206 Jun 17 11:50:57.203779 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 513/1022] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:50:57.336144 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a4e1803e-6174-4140-a34f-a3e781159a69 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.694419 Jun 17 11:50:57.342199 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 510/1023] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 17 11:50:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 11:50:57.351077 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8e352440-f26b-4291-a107-5e8d79913fcf tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:50:57.351804 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-8e352440-f26b-4291-a107-5e8d79913fcf tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] [instance: 8fc9a79b-2073-43de-a138-8fd2c211fbb8] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:50:57.430303 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-8e352440-f26b-4291-a107-5e8d79913fcf tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5306bf9994c53b874b7cad59f7dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a12c1715a684de19bfb01894e7677ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:50:57.441005 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-8e352440-f26b-4291-a107-5e8d79913fcf tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] 10.222.0.45 "GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8" status: 200 len: 1214 microversion: 2.1 time: 0.094170 Jun 17 11:50:57.442220 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 514/1024] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:50:57 2022] GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8 => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:50:57.445083 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b80431e6-d830-456d-99b4-fc1f64b0f634 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:50:57.445720 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b80431e6-d830-456d-99b4-fc1f64b0f634 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: b7e77bad-d147-495b-99e0-51905dd4860f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:50:57.456077 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b80431e6-d830-456d-99b4-fc1f64b0f634 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:57.456728 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b80431e6-d830-456d-99b4-fc1f64b0f634 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:57.457561 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b80431e6-d830-456d-99b4-fc1f64b0f634 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:57.458002 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b80431e6-d830-456d-99b4-fc1f64b0f634 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:57.674149 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b80431e6-d830-456d-99b4-fc1f64b0f634 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:50:57.681901 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b80431e6-d830-456d-99b4-fc1f64b0f634 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f" status: 200 len: 1318 microversion: 2.1 time: 0.241469 Jun 17 11:50:57.683021 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 511/1025] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:50:57 2022] GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:50:58.195875 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ee7e36cf-429c-4906-ae8f-0f83f3b3e061 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:50:58.196486 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-ee7e36cf-429c-4906-ae8f-0f83f3b3e061 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:50:58.203878 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ee7e36cf-429c-4906-ae8f-0f83f3b3e061 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:58.204322 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ee7e36cf-429c-4906-ae8f-0f83f3b3e061 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:58.205241 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ee7e36cf-429c-4906-ae8f-0f83f3b3e061 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:58.205682 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ee7e36cf-429c-4906-ae8f-0f83f3b3e061 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:58.270267 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ee7e36cf-429c-4906-ae8f-0f83f3b3e061 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:50:58.278942 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-ee7e36cf-429c-4906-ae8f-0f83f3b3e061 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1218 microversion: 2.1 time: 0.086909 Jun 17 11:50:58.279551 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 515/1026] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:50:58 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:50:58.461238 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-63c5a169-3ea6-47b0-b664-cc29d30a015d tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:50:58.461776 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-63c5a169-3ea6-47b0-b664-cc29d30a015d tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] [instance: 8fc9a79b-2073-43de-a138-8fd2c211fbb8] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:50:58.516557 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-63c5a169-3ea6-47b0-b664-cc29d30a015d tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5306bf9994c53b874b7cad59f7dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a12c1715a684de19bfb01894e7677ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:50:58.523654 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-63c5a169-3ea6-47b0-b664-cc29d30a015d tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] 10.222.0.45 "GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8" status: 200 len: 1214 microversion: 2.1 time: 0.066560 Jun 17 11:50:58.524392 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 512/1027] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:50:58 2022] GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:50:58.706824 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-bc450626-6068-4268-8af5-02441f94762d tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:50:58.707463 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-bc450626-6068-4268-8af5-02441f94762d tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: b7e77bad-d147-495b-99e0-51905dd4860f] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:50:58.709444 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:50:58.718056 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bc450626-6068-4268-8af5-02441f94762d tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:58.718056 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bc450626-6068-4268-8af5-02441f94762d tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:58.718056 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bc450626-6068-4268-8af5-02441f94762d tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:58.718056 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bc450626-6068-4268-8af5-02441f94762d tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:58.857938 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-bc450626-6068-4268-8af5-02441f94762d tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:50:58.865531 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-bc450626-6068-4268-8af5-02441f94762d tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f" status: 200 len: 1318 microversion: 2.1 time: 0.162599 Jun 17 11:50:58.866269 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 516/1028] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:50:58 2022] GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:50:59.296678 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a32ed7dc-6009-409f-b6c2-24f1ce4595d7 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:50:59.297709 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a32ed7dc-6009-409f-b6c2-24f1ce4595d7 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:50:59.305114 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a32ed7dc-6009-409f-b6c2-24f1ce4595d7 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:59.305565 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a32ed7dc-6009-409f-b6c2-24f1ce4595d7 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:59.306345 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a32ed7dc-6009-409f-b6c2-24f1ce4595d7 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:59.306774 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a32ed7dc-6009-409f-b6c2-24f1ce4595d7 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:59.345282 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a32ed7dc-6009-409f-b6c2-24f1ce4595d7 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:59.346397 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a32ed7dc-6009-409f-b6c2-24f1ce4595d7 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:59.346842 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-a32ed7dc-6009-409f-b6c2-24f1ce4595d7 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lazy-loading 'fault' on Instance uuid ef2e4aca-bc09-41dd-9f63-3a8649cf871c {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:50:59.396812 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a32ed7dc-6009-409f-b6c2-24f1ce4595d7 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948450e8b1fb4a85a40fbc0a0dacfdde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6832cdc6d4e43eb9eae4585ef36e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:50:59.405331 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a32ed7dc-6009-409f-b6c2-24f1ce4595d7 tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 200 len: 1223 microversion: 2.1 time: 0.113226 Jun 17 11:50:59.415350 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 513/1029] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:50:59 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 1223 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:50:59.542610 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a34dfec4-bdee-4885-8ba1-ed288137b644 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:50:59.543359 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a34dfec4-bdee-4885-8ba1-ed288137b644 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] [instance: 8fc9a79b-2073-43de-a138-8fd2c211fbb8] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:50:59.550913 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a34dfec4-bdee-4885-8ba1-ed288137b644 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:59.551358 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a34dfec4-bdee-4885-8ba1-ed288137b644 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:59.552239 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a34dfec4-bdee-4885-8ba1-ed288137b644 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:59.552673 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a34dfec4-bdee-4885-8ba1-ed288137b644 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:59.638215 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a34dfec4-bdee-4885-8ba1-ed288137b644 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5306bf9994c53b874b7cad59f7dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a12c1715a684de19bfb01894e7677ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:50:59.646454 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a34dfec4-bdee-4885-8ba1-ed288137b644 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] 10.222.0.45 "GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8" status: 200 len: 1210 microversion: 2.1 time: 0.108001 Jun 17 11:50:59.647061 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 517/1030] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:50:59 2022] GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8 => generated 1210 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:50:59.883463 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-46b30656-3f60-4123-8083-d77df5afc2fd tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:50:59.883992 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-46b30656-3f60-4123-8083-d77df5afc2fd tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: b7e77bad-d147-495b-99e0-51905dd4860f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:50:59.891253 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-46b30656-3f60-4123-8083-d77df5afc2fd tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:59.892894 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-46b30656-3f60-4123-8083-d77df5afc2fd tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:50:59.892894 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-46b30656-3f60-4123-8083-d77df5afc2fd tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:50:59.893129 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-46b30656-3f60-4123-8083-d77df5afc2fd tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:00.029290 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-46b30656-3f60-4123-8083-d77df5afc2fd tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:51:00.036937 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-46b30656-3f60-4123-8083-d77df5afc2fd tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f" status: 200 len: 1318 microversion: 2.1 time: 0.157510 Jun 17 11:51:00.037512 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 514/1031] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:50:59 2022] GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:51:00.428122 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-beb52ac1-a655-4721-a4db-2f6b6317da5f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:51:00.430341 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-beb52ac1-a655-4721-a4db-2f6b6317da5f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] [instance: ef2e4aca-bc09-41dd-9f63-3a8649cf871c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:51:00.440881 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-beb52ac1-a655-4721-a4db-2f6b6317da5f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:00.443793 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-beb52ac1-a655-4721-a4db-2f6b6317da5f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:00.443793 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-beb52ac1-a655-4721-a4db-2f6b6317da5f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:00.443793 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-beb52ac1-a655-4721-a4db-2f6b6317da5f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:00.461190 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-beb52ac1-a655-4721-a4db-2f6b6317da5f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] HTTP exception thrown: Instance ef2e4aca-bc09-41dd-9f63-3a8649cf871c could not be found. Jun 17 11:51:00.462981 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-beb52ac1-a655-4721-a4db-2f6b6317da5f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Request method failure captured: Jun 17 11:51:00.462981 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c HTTP/1.1 Jun 17 11:51:00.462981 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jun 17 11:51:00.462981 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jun 17 11:51:00.462981 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Connection: close Jun 17 11:51:00.462981 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jun 17 11:51:00.462981 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jun 17 11:51:00.462981 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.45 Jun 17 11:51:00.462981 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jun 17 11:51:00.462981 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jun 17 11:51:00.462981 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABirGlBdKSvG2g6-XW0E8-kCrpfkUCLTvvyNhc8ORN3Qr5rVnRBkvCr46__V51zjTPIV_ruUtZj7NO-kQhDQAH82MPkpztFDK1iaEaWZ8Gzf8zoq9h4rQpbv79H-8PPphGJGotLswIziKC5SRZhwXr8fhrunDoETM9GYqLHpaCH2Y-h-JY Jun 17 11:51:00.462981 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jun 17 11:51:00.462981 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jun 17 11:51:00.462981 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jun 17 11:51:00.462981 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jun 17 11:51:00.462981 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jun 17 11:51:00.462981 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jun 17 11:51:00.462981 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Id: f6832cdc6d4e43eb9eae4585ef36e611 Jun 17 11:51:00.462981 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-TestShelveInstance-1312094641 Jun 17 11:51:00.462981 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jun 17 11:51:00.462981 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jun 17 11:51:00.464711 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f6832cdc6d4e43eb9eae4585ef36e611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f6832cdc6d4e43eb9eae4585ef36e611", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f6832cdc6d4e43eb9eae4585ef36e611"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f6832cdc6d4e43eb9eae4585ef36e611"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:51:00.464711 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-TestShelveInstance-1312094641 Jun 17 11:51:00.464711 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: f6832cdc6d4e43eb9eae4585ef36e611 Jun 17 11:51:00.464711 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-TestShelveInstance-1312094641 Jun 17 11:51:00.464711 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User: tempest-TestShelveInstance-1312094641-project Jun 17 11:51:00.464711 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jun 17 11:51:00.464711 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jun 17 11:51:00.464711 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Id: 948450e8b1fb4a85a40fbc0a0dacfdde Jun 17 11:51:00.464711 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-TestShelveInstance-1312094641-project Jun 17 11:51:00.464711 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: method: > Jun 17 11:51:00.464711 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: exception: Instance ef2e4aca-bc09-41dd-9f63-3a8649cf871c could not be found. Jun 17 11:51:00.464711 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: action_args: {'id': 'ef2e4aca-bc09-41dd-9f63-3a8649cf871c'} Jun 17 11:51:00.465618 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:51:00.465618 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:51:00.465618 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:51:00.465618 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:51:00.465618 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:51:00.465618 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:51:00.465618 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:51:00.465618 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:51:00.465618 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:51:00.465618 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:51:00.465618 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef2e4aca-bc09-41dd-9f63-3a8649cf871c could not be found. Jun 17 11:51:00.465618 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:51:00.465618 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:51:00.465618 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:51:00.465618 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:51:00.465618 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:51:00.465618 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:51:00.465618 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:51:00.465618 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:51:00.465618 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:51:00.467038 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:51:00.467038 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 11:51:00.467038 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 11:51:00.467038 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:51:00.467038 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:51:00.467038 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:51:00.467038 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:51:00.467038 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef2e4aca-bc09-41dd-9f63-3a8649cf871c could not be found. Jun 17 11:51:00.467038 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:51:00.467038 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:51:00.467038 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:51:00.467038 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:51:00.467038 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:51:00.467038 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:51:00.467038 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:51:00.467038 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:51:00.467038 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef2e4aca-bc09-41dd-9f63-3a8649cf871c could not be found. Jun 17 11:51:00.467038 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:51:00.469146 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-beb52ac1-a655-4721-a4db-2f6b6317da5f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Returning 404 to user: Instance ef2e4aca-bc09-41dd-9f63-3a8649cf871c could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:51:00.469146 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-beb52ac1-a655-4721-a4db-2f6b6317da5f tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c" status: 404 len: 111 microversion: 2.1 time: 0.044180 Jun 17 11:51:00.469146 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 518/1032] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:51:00 2022] GET /compute/v2.1/servers/ef2e4aca-bc09-41dd-9f63-3a8649cf871c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:51:00.665669 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-312167dc-0f59-4b09-bc5a-d1fefcfda0dd tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:51:00.667212 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-312167dc-0f59-4b09-bc5a-d1fefcfda0dd tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] [instance: 8fc9a79b-2073-43de-a138-8fd2c211fbb8] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:51:00.675224 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-312167dc-0f59-4b09-bc5a-d1fefcfda0dd tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:00.676061 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-312167dc-0f59-4b09-bc5a-d1fefcfda0dd tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:00.677036 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-312167dc-0f59-4b09-bc5a-d1fefcfda0dd tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:00.677937 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-312167dc-0f59-4b09-bc5a-d1fefcfda0dd tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:01.002340 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-312167dc-0f59-4b09-bc5a-d1fefcfda0dd tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5306bf9994c53b874b7cad59f7dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a12c1715a684de19bfb01894e7677ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:51:01.011116 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-312167dc-0f59-4b09-bc5a-d1fefcfda0dd tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] 10.222.0.45 "GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8" status: 200 len: 1284 microversion: 2.1 time: 0.350676 Jun 17 11:51:01.011987 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 515/1033] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:51:00 2022] GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8 => generated 1284 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:51:01.054197 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-244f8ca0-5cd7-4a72-9df6-a06814dc9f79 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:51:01.054806 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-244f8ca0-5cd7-4a72-9df6-a06814dc9f79 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: b7e77bad-d147-495b-99e0-51905dd4860f] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:51:01.062407 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-244f8ca0-5cd7-4a72-9df6-a06814dc9f79 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:01.062885 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-244f8ca0-5cd7-4a72-9df6-a06814dc9f79 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:01.063936 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-244f8ca0-5cd7-4a72-9df6-a06814dc9f79 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:01.064335 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-244f8ca0-5cd7-4a72-9df6-a06814dc9f79 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:01.163228 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ed6e6efe-5ee5-4c18-b5c1-273d510e4a2b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] Calling method '.version_select at 0x7f9c7677f4c0>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:51:01.214391 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-244f8ca0-5cd7-4a72-9df6-a06814dc9f79 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:51:01.222439 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-244f8ca0-5cd7-4a72-9df6-a06814dc9f79 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f" status: 200 len: 1318 microversion: 2.1 time: 0.172105 Jun 17 11:51:01.223162 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 519/1034] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:51:01 2022] GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:51:01.283987 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ed6e6efe-5ee5-4c18-b5c1-273d510e4a2b tempest-TestShelveInstance-1312094641 tempest-TestShelveInstance-1312094641-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-98491439" status: 202 len: 0 microversion: 2.1 time: 0.124995 Jun 17 11:51:01.284584 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 516/1035] 10.222.0.45 () {58 vars in 1247 bytes} [Fri Jun 17 11:51:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-98491439 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 17 11:51:02.031657 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-40f3deec-ee62-447b-9208-fd9189947107 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:51:02.031921 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-40f3deec-ee62-447b-9208-fd9189947107 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] [instance: 8fc9a79b-2073-43de-a138-8fd2c211fbb8] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:51:02.038662 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-40f3deec-ee62-447b-9208-fd9189947107 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:02.039276 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-40f3deec-ee62-447b-9208-fd9189947107 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:02.040250 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-40f3deec-ee62-447b-9208-fd9189947107 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:02.040698 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-40f3deec-ee62-447b-9208-fd9189947107 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:02.240901 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3c2720bd-239d-41b6-9813-da7d0888d685 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:51:02.241530 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-3c2720bd-239d-41b6-9813-da7d0888d685 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: b7e77bad-d147-495b-99e0-51905dd4860f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:51:02.248177 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3c2720bd-239d-41b6-9813-da7d0888d685 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:02.248635 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3c2720bd-239d-41b6-9813-da7d0888d685 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:02.249427 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3c2720bd-239d-41b6-9813-da7d0888d685 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:02.250113 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3c2720bd-239d-41b6-9813-da7d0888d685 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:02.268089 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-40f3deec-ee62-447b-9208-fd9189947107 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5306bf9994c53b874b7cad59f7dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a12c1715a684de19bfb01894e7677ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:51:02.278942 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-40f3deec-ee62-447b-9208-fd9189947107 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] 10.222.0.45 "GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8" status: 200 len: 1314 microversion: 2.1 time: 0.253005 Jun 17 11:51:02.289085 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 520/1036] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:51:02 2022] GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:51:02.454356 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3c2720bd-239d-41b6-9813-da7d0888d685 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:51:02.462049 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-3c2720bd-239d-41b6-9813-da7d0888d685 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f" status: 200 len: 1318 microversion: 2.1 time: 0.226067 Jun 17 11:51:02.462631 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 517/1037] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:51:02 2022] GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:51:02.841164 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-579cf60b-f547-4759-a168-2e98eef80982 req-b0d7ed8d-733f-4abc-a5e5-c6e94e9aa503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7e77bad-d147-495b-99e0-51905dd4860f", "name": "network-vif-plugged", "status": "completed", "tag": "a033126a-b60e-4ebe-84b3-e71d2dc8d449"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:51:02.851867 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-579cf60b-f547-4759-a168-2e98eef80982 req-b0d7ed8d-733f-4abc-a5e5-c6e94e9aa503 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:02.852698 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-579cf60b-f547-4759-a168-2e98eef80982 req-b0d7ed8d-733f-4abc-a5e5-c6e94e9aa503 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:02.874449 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-579cf60b-f547-4759-a168-2e98eef80982 req-b0d7ed8d-733f-4abc-a5e5-c6e94e9aa503 service nova] Creating event network-vif-plugged:a033126a-b60e-4ebe-84b3-e71d2dc8d449 for instance b7e77bad-d147-495b-99e0-51905dd4860f on hv-cinder-83716 Jun 17 11:51:02.883295 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-579cf60b-f547-4759-a168-2e98eef80982 req-b0d7ed8d-733f-4abc-a5e5-c6e94e9aa503 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047585 Jun 17 11:51:02.884413 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 521/1038] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:51:03.068329 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-437a9e99-fb28-49dd-96fd-e79c8ef22790 req-e3b7ba86-a3d2-4911-9973-15196ab9ad58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fc9a79b-2073-43de-a138-8fd2c211fbb8", "tag": "db92c276-49ff-45c7-979f-72a5de0c471d"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:51:03.081902 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-437a9e99-fb28-49dd-96fd-e79c8ef22790 req-e3b7ba86-a3d2-4911-9973-15196ab9ad58 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:03.082069 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-437a9e99-fb28-49dd-96fd-e79c8ef22790 req-e3b7ba86-a3d2-4911-9973-15196ab9ad58 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:03.094279 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-437a9e99-fb28-49dd-96fd-e79c8ef22790 req-e3b7ba86-a3d2-4911-9973-15196ab9ad58 service nova] Creating event network-changed:db92c276-49ff-45c7-979f-72a5de0c471d for instance 8fc9a79b-2073-43de-a138-8fd2c211fbb8 on hv-cinder-83716 Jun 17 11:51:03.099833 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-437a9e99-fb28-49dd-96fd-e79c8ef22790 req-e3b7ba86-a3d2-4911-9973-15196ab9ad58 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035298 Jun 17 11:51:03.100803 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 518/1039] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:51:03.301276 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-54989845-0c4e-4212-a765-b45f2a3df190 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:51:03.303724 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-54989845-0c4e-4212-a765-b45f2a3df190 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] [instance: 8fc9a79b-2073-43de-a138-8fd2c211fbb8] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:51:03.313832 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-54989845-0c4e-4212-a765-b45f2a3df190 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:03.313832 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-54989845-0c4e-4212-a765-b45f2a3df190 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:03.320705 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-54989845-0c4e-4212-a765-b45f2a3df190 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:03.320705 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-54989845-0c4e-4212-a765-b45f2a3df190 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:03.481621 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d5f97c47-9f3f-479f-b890-a98496b54550 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:51:03.482342 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d5f97c47-9f3f-479f-b890-a98496b54550 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: b7e77bad-d147-495b-99e0-51905dd4860f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:51:03.489729 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d5f97c47-9f3f-479f-b890-a98496b54550 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:03.490188 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d5f97c47-9f3f-479f-b890-a98496b54550 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:03.491591 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d5f97c47-9f3f-479f-b890-a98496b54550 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:03.492059 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d5f97c47-9f3f-479f-b890-a98496b54550 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:03.517218 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-54989845-0c4e-4212-a765-b45f2a3df190 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5306bf9994c53b874b7cad59f7dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a12c1715a684de19bfb01894e7677ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:51:03.549054 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-54989845-0c4e-4212-a765-b45f2a3df190 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] 10.222.0.45 "GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8" status: 200 len: 1314 microversion: 2.1 time: 0.254784 Jun 17 11:51:03.549657 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 522/1040] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:51:03 2022] GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:51:03.726214 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d5f97c47-9f3f-479f-b890-a98496b54550 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:51:03.737960 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d5f97c47-9f3f-479f-b890-a98496b54550 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f" status: 200 len: 1318 microversion: 2.1 time: 0.261895 Jun 17 11:51:03.738597 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 519/1041] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:51:03 2022] GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:51:04.566188 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-dc2003c5-5179-467c-9003-3711347689c6 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:51:04.566947 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-dc2003c5-5179-467c-9003-3711347689c6 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] [instance: 8fc9a79b-2073-43de-a138-8fd2c211fbb8] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:51:04.574423 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-dc2003c5-5179-467c-9003-3711347689c6 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:04.576407 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-dc2003c5-5179-467c-9003-3711347689c6 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:04.576407 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-dc2003c5-5179-467c-9003-3711347689c6 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:04.576407 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-dc2003c5-5179-467c-9003-3711347689c6 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:04.712922 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-dc2003c5-5179-467c-9003-3711347689c6 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5306bf9994c53b874b7cad59f7dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a12c1715a684de19bfb01894e7677ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:51:04.720835 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-dc2003c5-5179-467c-9003-3711347689c6 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] 10.222.0.45 "GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8" status: 200 len: 1314 microversion: 2.1 time: 0.158621 Jun 17 11:51:04.721429 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 523/1042] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:51:04 2022] GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:51:04.755951 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4f50c0d6-6a28-4424-bea5-927b19b72214 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:51:04.756568 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4f50c0d6-6a28-4424-bea5-927b19b72214 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: b7e77bad-d147-495b-99e0-51905dd4860f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:51:04.764223 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4f50c0d6-6a28-4424-bea5-927b19b72214 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:04.764591 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4f50c0d6-6a28-4424-bea5-927b19b72214 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:04.765370 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4f50c0d6-6a28-4424-bea5-927b19b72214 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:04.765802 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4f50c0d6-6a28-4424-bea5-927b19b72214 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:04.925023 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4f50c0d6-6a28-4424-bea5-927b19b72214 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:51:04.933637 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4f50c0d6-6a28-4424-bea5-927b19b72214 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f" status: 200 len: 1318 microversion: 2.1 time: 0.181704 Jun 17 11:51:04.934294 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 520/1043] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:51:04 2022] GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:51:05.299024 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 11:51:05.299354 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Fri Jun 17 11:51:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 11:51:05.740107 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-628f6df9-bea6-448c-aef9-36c5d70fbad4 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:51:05.741110 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-628f6df9-bea6-448c-aef9-36c5d70fbad4 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] [instance: 8fc9a79b-2073-43de-a138-8fd2c211fbb8] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:51:05.748561 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-628f6df9-bea6-448c-aef9-36c5d70fbad4 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:05.749769 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-628f6df9-bea6-448c-aef9-36c5d70fbad4 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:05.750186 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-628f6df9-bea6-448c-aef9-36c5d70fbad4 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:05.750483 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-628f6df9-bea6-448c-aef9-36c5d70fbad4 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:05.773912 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:51:05.898330 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-628f6df9-bea6-448c-aef9-36c5d70fbad4 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5306bf9994c53b874b7cad59f7dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a12c1715a684de19bfb01894e7677ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:51:05.907066 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-628f6df9-bea6-448c-aef9-36c5d70fbad4 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] 10.222.0.45 "GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8" status: 200 len: 1314 microversion: 2.1 time: 0.170931 Jun 17 11:51:05.918671 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 524/1044] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:51:05 2022] GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:51:05.958404 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-620bff56-49b4-4e1e-8a52-d44ecc1591ed tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:51:05.960428 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-620bff56-49b4-4e1e-8a52-d44ecc1591ed tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: b7e77bad-d147-495b-99e0-51905dd4860f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:51:05.968892 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-620bff56-49b4-4e1e-8a52-d44ecc1591ed tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:05.970112 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-620bff56-49b4-4e1e-8a52-d44ecc1591ed tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:05.970682 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-620bff56-49b4-4e1e-8a52-d44ecc1591ed tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:05.971207 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-620bff56-49b4-4e1e-8a52-d44ecc1591ed tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:06.206004 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-620bff56-49b4-4e1e-8a52-d44ecc1591ed tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:51:06.215901 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-620bff56-49b4-4e1e-8a52-d44ecc1591ed tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f" status: 200 len: 1507 microversion: 2.1 time: 0.262069 Jun 17 11:51:06.221158 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 521/1045] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:51:05 2022] GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f => generated 1507 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:51:06.235833 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-83d803b1-033e-4ac3-ac65-fcbc07d3724f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0d68296-afd3-421e-94db-c310584dff57", "device": "/dev/sdb"}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:51:06.237367 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-83d803b1-033e-4ac3-ac65-fcbc07d3724f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: b7e77bad-d147-495b-99e0-51905dd4860f] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:51:06.247801 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-83d803b1-033e-4ac3-ac65-fcbc07d3724f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:06.249853 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-83d803b1-033e-4ac3-ac65-fcbc07d3724f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:06.249853 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-83d803b1-033e-4ac3-ac65-fcbc07d3724f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:06.250532 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-83d803b1-033e-4ac3-ac65-fcbc07d3724f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:06.924729 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b4decfb0-6113-4da7-b345-cdbab465efe3 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:51:06.925263 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b4decfb0-6113-4da7-b345-cdbab465efe3 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] [instance: 8fc9a79b-2073-43de-a138-8fd2c211fbb8] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:51:06.931847 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b4decfb0-6113-4da7-b345-cdbab465efe3 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:06.936829 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b4decfb0-6113-4da7-b345-cdbab465efe3 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:06.936829 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b4decfb0-6113-4da7-b345-cdbab465efe3 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:06.936829 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b4decfb0-6113-4da7-b345-cdbab465efe3 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:07.059234 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=2 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:51:07.166056 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b4decfb0-6113-4da7-b345-cdbab465efe3 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5306bf9994c53b874b7cad59f7dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a12c1715a684de19bfb01894e7677ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:51:07.170530 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b4decfb0-6113-4da7-b345-cdbab465efe3 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] 10.222.0.45 "GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8" status: 200 len: 1314 microversion: 2.1 time: 0.249892 Jun 17 11:51:07.171114 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 522/1046] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:51:06 2022] GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:51:07.207361 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-83d803b1-033e-4ac3-ac65-fcbc07d3724f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "POST /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.977711 Jun 17 11:51:07.208349 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 525/1047] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jun 17 11:51:06 2022] POST /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f/os-volume_attachments => generated 194 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:51:08.190369 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-9edf6ef2-5f0f-40a6-a975-c88e784fd52e tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:51:08.191420 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-9edf6ef2-5f0f-40a6-a975-c88e784fd52e tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] [instance: 8fc9a79b-2073-43de-a138-8fd2c211fbb8] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:51:08.200795 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9edf6ef2-5f0f-40a6-a975-c88e784fd52e tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:08.201557 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9edf6ef2-5f0f-40a6-a975-c88e784fd52e tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:08.202598 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9edf6ef2-5f0f-40a6-a975-c88e784fd52e tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:08.203170 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9edf6ef2-5f0f-40a6-a975-c88e784fd52e tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:08.521154 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=10 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:51:08.857106 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-9edf6ef2-5f0f-40a6-a975-c88e784fd52e tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5306bf9994c53b874b7cad59f7dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a12c1715a684de19bfb01894e7677ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:51:08.868055 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-9edf6ef2-5f0f-40a6-a975-c88e784fd52e tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] 10.222.0.45 "GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8" status: 200 len: 1314 microversion: 2.1 time: 0.682944 Jun 17 11:51:08.868878 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 523/1048] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:51:08 2022] GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8 => generated 1314 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:51:09.890145 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8af33cc6-52c5-46f1-b56d-db5fe96f7ee1 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:51:09.891433 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-8af33cc6-52c5-46f1-b56d-db5fe96f7ee1 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] [instance: 8fc9a79b-2073-43de-a138-8fd2c211fbb8] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:51:09.895215 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=8 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:51:09.909561 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8af33cc6-52c5-46f1-b56d-db5fe96f7ee1 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:09.910707 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8af33cc6-52c5-46f1-b56d-db5fe96f7ee1 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:09.912417 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8af33cc6-52c5-46f1-b56d-db5fe96f7ee1 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:09.913447 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8af33cc6-52c5-46f1-b56d-db5fe96f7ee1 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:10.091528 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-8af33cc6-52c5-46f1-b56d-db5fe96f7ee1 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5306bf9994c53b874b7cad59f7dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a12c1715a684de19bfb01894e7677ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:51:10.099416 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-8af33cc6-52c5-46f1-b56d-db5fe96f7ee1 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] 10.222.0.45 "GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8" status: 200 len: 1314 microversion: 2.1 time: 0.216817 Jun 17 11:51:10.100263 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 526/1049] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:51:09 2022] GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:51:10.792946 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-0dda2020-d1fd-4e60-97ed-dea6335a182c req-d1c5c7ac-48a6-48e3-a7b5-9b631f999cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fc9a79b-2073-43de-a138-8fd2c211fbb8", "name": "network-vif-plugged", "status": "completed", "tag": "db92c276-49ff-45c7-979f-72a5de0c471d"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:51:10.810545 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-0dda2020-d1fd-4e60-97ed-dea6335a182c req-d1c5c7ac-48a6-48e3-a7b5-9b631f999cf2 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:10.811351 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-0dda2020-d1fd-4e60-97ed-dea6335a182c req-d1c5c7ac-48a6-48e3-a7b5-9b631f999cf2 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:10.835492 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-0dda2020-d1fd-4e60-97ed-dea6335a182c req-d1c5c7ac-48a6-48e3-a7b5-9b631f999cf2 service nova] Creating event network-vif-plugged:db92c276-49ff-45c7-979f-72a5de0c471d for instance 8fc9a79b-2073-43de-a138-8fd2c211fbb8 on hv-cinder-83716 Jun 17 11:51:10.846423 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-0dda2020-d1fd-4e60-97ed-dea6335a182c req-d1c5c7ac-48a6-48e3-a7b5-9b631f999cf2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060744 Jun 17 11:51:10.847779 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 524/1050] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:51:11.120288 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ca94e3e1-c753-4b8f-8e1c-47e0cba715ce tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:51:11.121858 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-ca94e3e1-c753-4b8f-8e1c-47e0cba715ce tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] [instance: 8fc9a79b-2073-43de-a138-8fd2c211fbb8] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:51:11.131169 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ca94e3e1-c753-4b8f-8e1c-47e0cba715ce tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:11.131912 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ca94e3e1-c753-4b8f-8e1c-47e0cba715ce tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:11.132678 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ca94e3e1-c753-4b8f-8e1c-47e0cba715ce tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:11.133170 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ca94e3e1-c753-4b8f-8e1c-47e0cba715ce tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:11.384956 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ca94e3e1-c753-4b8f-8e1c-47e0cba715ce tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5306bf9994c53b874b7cad59f7dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a12c1715a684de19bfb01894e7677ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:51:11.414711 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-ca94e3e1-c753-4b8f-8e1c-47e0cba715ce tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] 10.222.0.45 "GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8" status: 200 len: 1314 microversion: 2.1 time: 0.299280 Jun 17 11:51:11.416040 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 527/1051] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:51:11 2022] GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:51:12.445810 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2ae68d56-40d1-4971-acbc-673e7963db15 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:51:12.447139 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-2ae68d56-40d1-4971-acbc-673e7963db15 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] [instance: 8fc9a79b-2073-43de-a138-8fd2c211fbb8] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:51:12.459302 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2ae68d56-40d1-4971-acbc-673e7963db15 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:12.460261 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2ae68d56-40d1-4971-acbc-673e7963db15 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:12.461611 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2ae68d56-40d1-4971-acbc-673e7963db15 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:12.462663 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2ae68d56-40d1-4971-acbc-673e7963db15 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:12.495820 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=100 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:51:12.647785 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2ae68d56-40d1-4971-acbc-673e7963db15 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5306bf9994c53b874b7cad59f7dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a12c1715a684de19bfb01894e7677ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:51:12.674497 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2ae68d56-40d1-4971-acbc-673e7963db15 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] 10.222.0.45 "GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8" status: 200 len: 1314 microversion: 2.1 time: 0.232765 Jun 17 11:51:12.674497 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 525/1052] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:51:12 2022] GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:51:13.751839 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e4fce394-291d-447d-93fa-28ea1d435e5e tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:51:13.752739 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-e4fce394-291d-447d-93fa-28ea1d435e5e tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] [instance: 8fc9a79b-2073-43de-a138-8fd2c211fbb8] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:51:13.760673 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e4fce394-291d-447d-93fa-28ea1d435e5e tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:13.761253 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e4fce394-291d-447d-93fa-28ea1d435e5e tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:13.761982 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e4fce394-291d-447d-93fa-28ea1d435e5e tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:13.762437 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e4fce394-291d-447d-93fa-28ea1d435e5e tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:13.913777 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-e4fce394-291d-447d-93fa-28ea1d435e5e tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5306bf9994c53b874b7cad59f7dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a12c1715a684de19bfb01894e7677ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:51:13.922855 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-e4fce394-291d-447d-93fa-28ea1d435e5e tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] 10.222.0.45 "GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8" status: 200 len: 1464 microversion: 2.1 time: 0.175231 Jun 17 11:51:13.923557 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 528/1053] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:51:13 2022] GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8 => generated 1464 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:51:13.970020 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c39826ac-6b79-4f20-ac00-df1ac6968323 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:51:13.970901 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c39826ac-6b79-4f20-ac00-df1ac6968323 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] [instance: 8fc9a79b-2073-43de-a138-8fd2c211fbb8] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:51:13.977726 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c39826ac-6b79-4f20-ac00-df1ac6968323 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:13.978182 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c39826ac-6b79-4f20-ac00-df1ac6968323 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:13.979177 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c39826ac-6b79-4f20-ac00-df1ac6968323 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:13.979654 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c39826ac-6b79-4f20-ac00-df1ac6968323 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:14.010609 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c39826ac-6b79-4f20-ac00-df1ac6968323 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] [instance: 8fc9a79b-2073-43de-a138-8fd2c211fbb8] Going to try to terminate instance {{(pid=124844) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 11:51:14.637823 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c39826ac-6b79-4f20-ac00-df1ac6968323 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8" status: 204 len: 0 microversion: 2.1 time: 0.673955 Jun 17 11:51:14.638458 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 526/1054] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 17 11:51:13 2022] DELETE /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 11:51:14.655136 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-67cc67b2-0290-4e4f-83a4-3f5083a660f2 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:51:14.656061 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-67cc67b2-0290-4e4f-83a4-3f5083a660f2 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] [instance: 8fc9a79b-2073-43de-a138-8fd2c211fbb8] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:51:14.664703 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-67cc67b2-0290-4e4f-83a4-3f5083a660f2 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:14.665758 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-67cc67b2-0290-4e4f-83a4-3f5083a660f2 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:14.666532 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-67cc67b2-0290-4e4f-83a4-3f5083a660f2 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:14.667491 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-67cc67b2-0290-4e4f-83a4-3f5083a660f2 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:14.831228 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-67cc67b2-0290-4e4f-83a4-3f5083a660f2 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5306bf9994c53b874b7cad59f7dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a12c1715a684de19bfb01894e7677ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:51:14.839926 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-67cc67b2-0290-4e4f-83a4-3f5083a660f2 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] 10.222.0.45 "GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8" status: 200 len: 1470 microversion: 2.1 time: 0.191173 Jun 17 11:51:14.840529 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 529/1055] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:51:14 2022] GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8 => generated 1470 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:51:15.860116 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-29446668-1d47-4da8-b033-c1433c143e4f tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:51:15.860501 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-29446668-1d47-4da8-b033-c1433c143e4f tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] [instance: 8fc9a79b-2073-43de-a138-8fd2c211fbb8] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:51:15.867194 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-29446668-1d47-4da8-b033-c1433c143e4f tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:15.867707 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-29446668-1d47-4da8-b033-c1433c143e4f tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:15.868523 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-29446668-1d47-4da8-b033-c1433c143e4f tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:15.868967 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-29446668-1d47-4da8-b033-c1433c143e4f tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:16.023260 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-29446668-1d47-4da8-b033-c1433c143e4f tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5306bf9994c53b874b7cad59f7dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a12c1715a684de19bfb01894e7677ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:51:16.032009 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-29446668-1d47-4da8-b033-c1433c143e4f tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] 10.222.0.45 "GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8" status: 200 len: 1470 microversion: 2.1 time: 0.177843 Jun 17 11:51:16.032522 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 527/1056] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:51:15 2022] GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8 => generated 1470 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:51:16.597803 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-af5db21e-f886-4228-b9b9-570b18aed0e0 req-0a4f56bd-db34-4306-bca0-9b0b009aeab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fc9a79b-2073-43de-a138-8fd2c211fbb8", "name": "network-vif-deleted", "tag": "db92c276-49ff-45c7-979f-72a5de0c471d"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:51:16.608125 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-af5db21e-f886-4228-b9b9-570b18aed0e0 req-0a4f56bd-db34-4306-bca0-9b0b009aeab4 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:16.608567 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-af5db21e-f886-4228-b9b9-570b18aed0e0 req-0a4f56bd-db34-4306-bca0-9b0b009aeab4 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:16.623391 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-af5db21e-f886-4228-b9b9-570b18aed0e0 req-0a4f56bd-db34-4306-bca0-9b0b009aeab4 service nova] Creating event network-vif-deleted:db92c276-49ff-45c7-979f-72a5de0c471d for instance 8fc9a79b-2073-43de-a138-8fd2c211fbb8 on hv-cinder-83716 Jun 17 11:51:16.629230 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-af5db21e-f886-4228-b9b9-570b18aed0e0 req-0a4f56bd-db34-4306-bca0-9b0b009aeab4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035077 Jun 17 11:51:16.630473 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 530/1057] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:51:17.049896 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b01e4e2a-8400-4d0b-ae72-d449c88d2857 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:51:17.050488 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b01e4e2a-8400-4d0b-ae72-d449c88d2857 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] [instance: 8fc9a79b-2073-43de-a138-8fd2c211fbb8] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:51:17.057909 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b01e4e2a-8400-4d0b-ae72-d449c88d2857 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:17.058363 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b01e4e2a-8400-4d0b-ae72-d449c88d2857 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:17.059135 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b01e4e2a-8400-4d0b-ae72-d449c88d2857 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:17.059601 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b01e4e2a-8400-4d0b-ae72-d449c88d2857 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:17.124316 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b01e4e2a-8400-4d0b-ae72-d449c88d2857 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5306bf9994c53b874b7cad59f7dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a12c1715a684de19bfb01894e7677ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:51:17.132349 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b01e4e2a-8400-4d0b-ae72-d449c88d2857 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] 10.222.0.45 "GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8" status: 200 len: 1299 microversion: 2.1 time: 0.086235 Jun 17 11:51:17.132941 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 528/1058] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:51:17 2022] GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8 => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:51:18.151976 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-99dfc4a0-a16b-4947-a8ce-30f00b643fe9 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:51:18.152699 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-99dfc4a0-a16b-4947-a8ce-30f00b643fe9 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] [instance: 8fc9a79b-2073-43de-a138-8fd2c211fbb8] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:51:18.154758 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:51:18.159798 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-99dfc4a0-a16b-4947-a8ce-30f00b643fe9 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:18.160258 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-99dfc4a0-a16b-4947-a8ce-30f00b643fe9 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:18.161025 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-99dfc4a0-a16b-4947-a8ce-30f00b643fe9 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:18.161466 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-99dfc4a0-a16b-4947-a8ce-30f00b643fe9 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:18.230436 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-99dfc4a0-a16b-4947-a8ce-30f00b643fe9 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5306bf9994c53b874b7cad59f7dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a12c1715a684de19bfb01894e7677ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:51:18.238129 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-99dfc4a0-a16b-4947-a8ce-30f00b643fe9 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] 10.222.0.45 "GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8" status: 200 len: 1299 microversion: 2.1 time: 0.091743 Jun 17 11:51:18.238703 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 531/1059] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:51:18 2022] GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8 => generated 1299 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:51:19.256046 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-79af406f-f059-4ec8-9c47-ea6eb045c6b3 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:51:19.256668 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-79af406f-f059-4ec8-9c47-ea6eb045c6b3 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] [instance: 8fc9a79b-2073-43de-a138-8fd2c211fbb8] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:51:19.263329 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-79af406f-f059-4ec8-9c47-ea6eb045c6b3 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:19.263815 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-79af406f-f059-4ec8-9c47-ea6eb045c6b3 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:19.264629 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-79af406f-f059-4ec8-9c47-ea6eb045c6b3 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:19.265100 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-79af406f-f059-4ec8-9c47-ea6eb045c6b3 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:19.330798 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-79af406f-f059-4ec8-9c47-ea6eb045c6b3 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5306bf9994c53b874b7cad59f7dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a12c1715a684de19bfb01894e7677ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:51:19.338890 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-79af406f-f059-4ec8-9c47-ea6eb045c6b3 tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] 10.222.0.45 "GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8" status: 200 len: 1299 microversion: 2.1 time: 0.087372 Jun 17 11:51:19.339684 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 529/1060] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:51:19 2022] GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8 => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:51:20.355974 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-94f8defc-1a49-4f4a-a192-d45c12efe2be tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:51:20.356589 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-94f8defc-1a49-4f4a-a192-d45c12efe2be tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] [instance: 8fc9a79b-2073-43de-a138-8fd2c211fbb8] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:51:20.364014 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-94f8defc-1a49-4f4a-a192-d45c12efe2be tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:20.364468 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-94f8defc-1a49-4f4a-a192-d45c12efe2be tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:20.365247 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-94f8defc-1a49-4f4a-a192-d45c12efe2be tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:20.365684 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-94f8defc-1a49-4f4a-a192-d45c12efe2be tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:20.380602 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-94f8defc-1a49-4f4a-a192-d45c12efe2be tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] HTTP exception thrown: Instance 8fc9a79b-2073-43de-a138-8fd2c211fbb8 could not be found. Jun 17 11:51:20.382287 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-94f8defc-1a49-4f4a-a192-d45c12efe2be tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Request method failure captured: Jun 17 11:51:20.382287 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8 HTTP/1.1 Jun 17 11:51:20.382287 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jun 17 11:51:20.382287 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jun 17 11:51:20.382287 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Connection: close Jun 17 11:51:20.382287 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jun 17 11:51:20.382287 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jun 17 11:51:20.382287 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.45 Jun 17 11:51:20.382287 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jun 17 11:51:20.382287 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jun 17 11:51:20.382287 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABirGqeaHkGrzW3Ebi_TmJecLSgo-GdB7HIq1DWOpNNOBAqr4mUAjCTGUzluUF2_kflBljK4oxreAwIIbPrjXofmPJCMOAnboU9YitF5dbI9YgIphkpKTVqxcUtJHPQtp8Jvke2UoS6wGxnlARsdkL3eHkjV1cQqX5834wUhSv9WIKxy40 Jun 17 11:51:20.382287 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jun 17 11:51:20.382287 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jun 17 11:51:20.382287 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jun 17 11:51:20.382287 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jun 17 11:51:20.382287 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jun 17 11:51:20.382287 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jun 17 11:51:20.382287 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Id: 8a12c1715a684de19bfb01894e7677ee Jun 17 11:51:20.382287 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-VolumesNegativeTest-534149373 Jun 17 11:51:20.382287 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jun 17 11:51:20.382287 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jun 17 11:51:20.391283 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/8a12c1715a684de19bfb01894e7677ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_8a12c1715a684de19bfb01894e7677ee", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8a12c1715a684de19bfb01894e7677ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8a12c1715a684de19bfb01894e7677ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:51:20.391283 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-VolumesNegativeTest-534149373 Jun 17 11:51:20.391283 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: 8a12c1715a684de19bfb01894e7677ee Jun 17 11:51:20.391283 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-VolumesNegativeTest-534149373 Jun 17 11:51:20.391283 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User: tempest-VolumesNegativeTest-534149373-project Jun 17 11:51:20.391283 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jun 17 11:51:20.391283 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jun 17 11:51:20.391283 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Id: 2bd5306bf9994c53b874b7cad59f7dc1 Jun 17 11:51:20.391283 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-VolumesNegativeTest-534149373-project Jun 17 11:51:20.391283 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: method: > Jun 17 11:51:20.391283 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: exception: Instance 8fc9a79b-2073-43de-a138-8fd2c211fbb8 could not be found. Jun 17 11:51:20.391283 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: action_args: {'id': '8fc9a79b-2073-43de-a138-8fd2c211fbb8'} Jun 17 11:51:20.392338 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:51:20.392338 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:51:20.392338 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:51:20.392338 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:51:20.392338 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:51:20.392338 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:51:20.392338 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:51:20.392338 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:51:20.392338 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:51:20.392338 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:51:20.392338 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fc9a79b-2073-43de-a138-8fd2c211fbb8 could not be found. Jun 17 11:51:20.392338 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:51:20.392338 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:51:20.392338 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:51:20.392338 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:51:20.392338 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:51:20.392338 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:51:20.392338 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:51:20.392338 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:51:20.392338 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:51:20.394730 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:51:20.394730 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 11:51:20.394730 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 11:51:20.394730 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:51:20.394730 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:51:20.394730 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:51:20.394730 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:51:20.394730 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fc9a79b-2073-43de-a138-8fd2c211fbb8 could not be found. Jun 17 11:51:20.394730 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:51:20.394730 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:51:20.394730 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:51:20.394730 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:51:20.394730 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:51:20.394730 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:51:20.394730 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:51:20.394730 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:51:20.394730 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fc9a79b-2073-43de-a138-8fd2c211fbb8 could not be found. Jun 17 11:51:20.394730 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:51:20.396160 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-94f8defc-1a49-4f4a-a192-d45c12efe2be tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] Returning 404 to user: Instance 8fc9a79b-2073-43de-a138-8fd2c211fbb8 could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:51:20.396160 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-94f8defc-1a49-4f4a-a192-d45c12efe2be tempest-VolumesNegativeTest-534149373 tempest-VolumesNegativeTest-534149373-project] 10.222.0.45 "GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8" status: 404 len: 111 microversion: 2.1 time: 0.031703 Jun 17 11:51:20.396160 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 532/1061] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:51:20 2022] GET /compute/v2.1/servers/8fc9a79b-2073-43de-a138-8fd2c211fbb8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:51:28.866809 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c21bfa6e-0464-4550-8c0f-497ea1d3af13 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:51:28.867397 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c21bfa6e-0464-4550-8c0f-497ea1d3af13 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: b7e77bad-d147-495b-99e0-51905dd4860f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:51:28.870040 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:51:28.875299 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c21bfa6e-0464-4550-8c0f-497ea1d3af13 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:28.875836 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c21bfa6e-0464-4550-8c0f-497ea1d3af13 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:28.876566 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c21bfa6e-0464-4550-8c0f-497ea1d3af13 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:28.876999 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c21bfa6e-0464-4550-8c0f-497ea1d3af13 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:28.966750 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-c21bfa6e-0464-4550-8c0f-497ea1d3af13 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lazy-loading 'services' on Instance uuid b7e77bad-d147-495b-99e0-51905dd4860f {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:51:29.448889 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c21bfa6e-0464-4550-8c0f-497ea1d3af13 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f/os-volume_attachments/a0d68296-afd3-421e-94db-c310584dff57" status: 202 len: 0 microversion: 2.1 time: 0.584991 Jun 17 11:51:29.450994 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 530/1062] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Jun 17 11:51:28 2022] DELETE /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f/os-volume_attachments/a0d68296-afd3-421e-94db-c310584dff57 => generated 0 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 11:51:30.590343 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6fc066a9-567d-48af-ae04-9c02658a5516 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:51:30.590951 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-6fc066a9-567d-48af-ae04-9c02658a5516 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: b7e77bad-d147-495b-99e0-51905dd4860f] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:51:30.593704 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:51:30.598931 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6fc066a9-567d-48af-ae04-9c02658a5516 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:30.599447 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6fc066a9-567d-48af-ae04-9c02658a5516 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:30.600229 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6fc066a9-567d-48af-ae04-9c02658a5516 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:30.600765 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6fc066a9-567d-48af-ae04-9c02658a5516 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:30.634329 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-6fc066a9-567d-48af-ae04-9c02658a5516 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: b7e77bad-d147-495b-99e0-51905dd4860f] Going to try to terminate instance {{(pid=124845) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 11:51:31.025299 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-6fc066a9-567d-48af-ae04-9c02658a5516 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f" status: 204 len: 0 microversion: 2.1 time: 0.439292 Jun 17 11:51:31.026064 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 533/1063] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 17 11:51:30 2022] DELETE /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 11:51:31.035554 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-752d1732-d3a6-4193-a4e8-820bcaf10a6e tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:51:31.037502 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-752d1732-d3a6-4193-a4e8-820bcaf10a6e tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: b7e77bad-d147-495b-99e0-51905dd4860f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:51:31.043708 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-752d1732-d3a6-4193-a4e8-820bcaf10a6e tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:31.044159 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-752d1732-d3a6-4193-a4e8-820bcaf10a6e tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:31.044974 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-752d1732-d3a6-4193-a4e8-820bcaf10a6e tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:31.045457 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-752d1732-d3a6-4193-a4e8-820bcaf10a6e tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:31.188384 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-752d1732-d3a6-4193-a4e8-820bcaf10a6e tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:51:31.196418 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-752d1732-d3a6-4193-a4e8-820bcaf10a6e tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f" status: 200 len: 1513 microversion: 2.1 time: 0.165474 Jun 17 11:51:31.197012 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 531/1064] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:51:31 2022] GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:51:32.215284 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6b0133bb-937b-46ce-a58a-3b28a54b5feb tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:51:32.216005 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-6b0133bb-937b-46ce-a58a-3b28a54b5feb tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: b7e77bad-d147-495b-99e0-51905dd4860f] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:51:32.223140 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6b0133bb-937b-46ce-a58a-3b28a54b5feb tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:32.223622 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6b0133bb-937b-46ce-a58a-3b28a54b5feb tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:32.224400 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6b0133bb-937b-46ce-a58a-3b28a54b5feb tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:32.224837 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6b0133bb-937b-46ce-a58a-3b28a54b5feb tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:32.382392 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6b0133bb-937b-46ce-a58a-3b28a54b5feb tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:51:32.391236 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-6b0133bb-937b-46ce-a58a-3b28a54b5feb tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f" status: 200 len: 1513 microversion: 2.1 time: 0.180533 Jun 17 11:51:32.391831 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 534/1065] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:51:32 2022] GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f => generated 1513 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:51:33.408182 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-598344f6-23c7-4503-a8f0-0156939a1404 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:51:33.408793 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-598344f6-23c7-4503-a8f0-0156939a1404 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: b7e77bad-d147-495b-99e0-51905dd4860f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:51:33.417011 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-598344f6-23c7-4503-a8f0-0156939a1404 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:33.417615 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-598344f6-23c7-4503-a8f0-0156939a1404 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:33.418566 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-598344f6-23c7-4503-a8f0-0156939a1404 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:33.419158 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-598344f6-23c7-4503-a8f0-0156939a1404 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:33.558816 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-598344f6-23c7-4503-a8f0-0156939a1404 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:51:33.567602 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-598344f6-23c7-4503-a8f0-0156939a1404 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f" status: 200 len: 1513 microversion: 2.1 time: 0.163227 Jun 17 11:51:33.568194 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 532/1066] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:51:33 2022] GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:51:34.586494 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c2fcd39a-187c-454d-8f7b-f3dd184ccc2f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:51:34.587220 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c2fcd39a-187c-454d-8f7b-f3dd184ccc2f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: b7e77bad-d147-495b-99e0-51905dd4860f] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:51:34.595024 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c2fcd39a-187c-454d-8f7b-f3dd184ccc2f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:34.596098 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c2fcd39a-187c-454d-8f7b-f3dd184ccc2f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:34.596263 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c2fcd39a-187c-454d-8f7b-f3dd184ccc2f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:34.596662 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c2fcd39a-187c-454d-8f7b-f3dd184ccc2f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:34.737742 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c2fcd39a-187c-454d-8f7b-f3dd184ccc2f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:51:34.745845 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c2fcd39a-187c-454d-8f7b-f3dd184ccc2f tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f" status: 200 len: 1513 microversion: 2.1 time: 0.163584 Jun 17 11:51:34.746436 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 535/1067] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:51:34 2022] GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:51:35.763106 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-9eaad52f-b6d8-4bbd-93ea-4ea70d29bfd6 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:51:35.763793 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-9eaad52f-b6d8-4bbd-93ea-4ea70d29bfd6 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: b7e77bad-d147-495b-99e0-51905dd4860f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:51:35.771176 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9eaad52f-b6d8-4bbd-93ea-4ea70d29bfd6 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:35.771654 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9eaad52f-b6d8-4bbd-93ea-4ea70d29bfd6 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:35.772439 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9eaad52f-b6d8-4bbd-93ea-4ea70d29bfd6 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:35.772876 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9eaad52f-b6d8-4bbd-93ea-4ea70d29bfd6 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:36.014810 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-9eaad52f-b6d8-4bbd-93ea-4ea70d29bfd6 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:51:36.024498 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-9eaad52f-b6d8-4bbd-93ea-4ea70d29bfd6 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f" status: 200 len: 1513 microversion: 2.1 time: 0.265507 Jun 17 11:51:36.025097 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 533/1068] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:51:35 2022] GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f => generated 1513 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:51:36.148262 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-17c79669-deb3-4785-82f6-e8f58e6622ff req-1af9ca55-ba81-46ae-b9f6-342087290e4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7e77bad-d147-495b-99e0-51905dd4860f", "name": "network-vif-deleted", "tag": "a033126a-b60e-4ebe-84b3-e71d2dc8d449"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:51:36.157603 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-17c79669-deb3-4785-82f6-e8f58e6622ff req-1af9ca55-ba81-46ae-b9f6-342087290e4a service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:36.158051 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-17c79669-deb3-4785-82f6-e8f58e6622ff req-1af9ca55-ba81-46ae-b9f6-342087290e4a service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:36.172686 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-17c79669-deb3-4785-82f6-e8f58e6622ff req-1af9ca55-ba81-46ae-b9f6-342087290e4a service nova] Creating event network-vif-deleted:a033126a-b60e-4ebe-84b3-e71d2dc8d449 for instance b7e77bad-d147-495b-99e0-51905dd4860f on hv-cinder-83716 Jun 17 11:51:36.175980 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-17c79669-deb3-4785-82f6-e8f58e6622ff req-1af9ca55-ba81-46ae-b9f6-342087290e4a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183408 Jun 17 11:51:36.176587 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 536/1069] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 11:51:37.043142 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b6a42ff1-24ac-4bb2-93ea-12e57fd3e005 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:51:37.043924 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b6a42ff1-24ac-4bb2-93ea-12e57fd3e005 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: b7e77bad-d147-495b-99e0-51905dd4860f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:51:37.050946 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b6a42ff1-24ac-4bb2-93ea-12e57fd3e005 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:37.051432 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b6a42ff1-24ac-4bb2-93ea-12e57fd3e005 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:37.052263 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b6a42ff1-24ac-4bb2-93ea-12e57fd3e005 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:37.052706 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b6a42ff1-24ac-4bb2-93ea-12e57fd3e005 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:37.091305 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b6a42ff1-24ac-4bb2-93ea-12e57fd3e005 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:37.091812 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b6a42ff1-24ac-4bb2-93ea-12e57fd3e005 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:37.092325 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-b6a42ff1-24ac-4bb2-93ea-12e57fd3e005 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lazy-loading 'fault' on Instance uuid b7e77bad-d147-495b-99e0-51905dd4860f {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:51:37.147146 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b6a42ff1-24ac-4bb2-93ea-12e57fd3e005 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbcf7bbf6ef4e9a9a1e7ab5802ce12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab294243e474e34a2c6eec07747bf0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:51:37.157325 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b6a42ff1-24ac-4bb2-93ea-12e57fd3e005 tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f" status: 200 len: 1308 microversion: 2.1 time: 0.118834 Jun 17 11:51:37.158022 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 534/1070] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:51:37 2022] GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f => generated 1308 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:51:38.182825 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-70980c70-13f5-4e65-b1a6-194bb15b712c tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:51:38.183982 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-70980c70-13f5-4e65-b1a6-194bb15b712c tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] [instance: b7e77bad-d147-495b-99e0-51905dd4860f] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:51:38.192824 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-70980c70-13f5-4e65-b1a6-194bb15b712c tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:38.193464 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-70980c70-13f5-4e65-b1a6-194bb15b712c tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:38.194342 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-70980c70-13f5-4e65-b1a6-194bb15b712c tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:51:38.194886 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-70980c70-13f5-4e65-b1a6-194bb15b712c tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:51:38.211298 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-70980c70-13f5-4e65-b1a6-194bb15b712c tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] HTTP exception thrown: Instance b7e77bad-d147-495b-99e0-51905dd4860f could not be found. Jun 17 11:51:38.214485 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-70980c70-13f5-4e65-b1a6-194bb15b712c tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Request method failure captured: Jun 17 11:51:38.214485 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f HTTP/1.1 Jun 17 11:51:38.214485 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jun 17 11:51:38.214485 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jun 17 11:51:38.214485 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Connection: close Jun 17 11:51:38.214485 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jun 17 11:51:38.214485 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jun 17 11:51:38.214485 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.45 Jun 17 11:51:38.214485 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jun 17 11:51:38.214485 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jun 17 11:51:38.214485 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABirGpCGaDb67K2rFXXXI1y3u9xx4GNB9MHBbgJZ8gj1_SL38lw9IBaJrITSDqaUp-Y_xeGfUh18yADf61kBUJbIKGXgH9GG6mBe1jT2JiSuKvN675ZqrYF7eb9AkYWq8vzXHh1v6o776lCEdE1gg8DBw25llJaRP3V_nm7LtpSZc4S25I Jun 17 11:51:38.214485 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jun 17 11:51:38.214485 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jun 17 11:51:38.214485 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jun 17 11:51:38.214485 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jun 17 11:51:38.214485 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jun 17 11:51:38.214485 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jun 17 11:51:38.214485 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Id: eab294243e474e34a2c6eec07747bf0d Jun 17 11:51:38.214485 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-VolumesSnapshotTestJSON-240803090 Jun 17 11:51:38.214485 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jun 17 11:51:38.214485 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jun 17 11:51:38.221729 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/eab294243e474e34a2c6eec07747bf0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_eab294243e474e34a2c6eec07747bf0d", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eab294243e474e34a2c6eec07747bf0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eab294243e474e34a2c6eec07747bf0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:51:38.221729 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-VolumesSnapshotTestJSON-240803090 Jun 17 11:51:38.221729 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: eab294243e474e34a2c6eec07747bf0d Jun 17 11:51:38.221729 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-240803090 Jun 17 11:51:38.221729 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User: tempest-VolumesSnapshotTestJSON-240803090-project Jun 17 11:51:38.221729 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jun 17 11:51:38.221729 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jun 17 11:51:38.221729 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Id: fdbcf7bbf6ef4e9a9a1e7ab5802ce12d Jun 17 11:51:38.221729 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-VolumesSnapshotTestJSON-240803090-project Jun 17 11:51:38.221729 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: method: > Jun 17 11:51:38.221729 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: exception: Instance b7e77bad-d147-495b-99e0-51905dd4860f could not be found. Jun 17 11:51:38.221729 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: action_args: {'id': 'b7e77bad-d147-495b-99e0-51905dd4860f'} Jun 17 11:51:38.223139 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:51:38.223139 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:51:38.223139 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:51:38.223139 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:51:38.223139 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:51:38.223139 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:51:38.223139 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:51:38.223139 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:51:38.223139 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:51:38.223139 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:51:38.223139 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7e77bad-d147-495b-99e0-51905dd4860f could not be found. Jun 17 11:51:38.223139 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:51:38.223139 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:51:38.223139 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:51:38.223139 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:51:38.223139 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:51:38.223139 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:51:38.223139 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:51:38.223139 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:51:38.223139 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:51:38.224713 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:51:38.224713 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 11:51:38.224713 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 11:51:38.224713 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:51:38.224713 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:51:38.224713 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:51:38.224713 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:51:38.224713 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7e77bad-d147-495b-99e0-51905dd4860f could not be found. Jun 17 11:51:38.224713 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:51:38.224713 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:51:38.224713 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:51:38.224713 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:51:38.224713 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:51:38.224713 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:51:38.224713 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:51:38.224713 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:51:38.224713 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7e77bad-d147-495b-99e0-51905dd4860f could not be found. Jun 17 11:51:38.224713 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:51:38.226430 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-70980c70-13f5-4e65-b1a6-194bb15b712c tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] Returning 404 to user: Instance b7e77bad-d147-495b-99e0-51905dd4860f could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:51:38.226430 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-70980c70-13f5-4e65-b1a6-194bb15b712c tempest-VolumesSnapshotTestJSON-240803090 tempest-VolumesSnapshotTestJSON-240803090-project] 10.222.0.45 "GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f" status: 404 len: 111 microversion: 2.1 time: 0.042575 Jun 17 11:51:38.226430 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 537/1071] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:51:38 2022] GET /compute/v2.1/servers/b7e77bad-d147-495b-99e0-51905dd4860f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:52:21.272543 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=11 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:52:21.273774 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:52:21.465612 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c4eb82db-b933-4c14-94e0-c402d4bb8f10 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Action: 'create', calling method: .version_select at 0x7f9c767860d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-577758725", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8LT5i7tShoUVByxzzloY0A+5+eqCiVkEqC+mvapILTHJAKI7KQlQA5B/scN2o57Y9OaXhr5st30IToItefG29o2+yujtDUeU2oNjmp3GgRKIaAvqLSslM0dkcCTBxKEQ=="}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:52:21.481841 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-c4eb82db-b933-4c14-94e0-c402d4bb8f10 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Getting quotas for project 17575f4a36b94fdfb338dd1ba516d58e. Resources: {'key_pairs'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 11:52:21.486643 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-c4eb82db-b933-4c14-94e0-c402d4bb8f10 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Getting quotas for user b5443b1aec1b414fad8bdd9f731ae7dc and project 17575f4a36b94fdfb338dd1ba516d58e. Resources: {'key_pairs'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 11:52:21.611396 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c4eb82db-b933-4c14-94e0-c402d4bb8f10 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.343889 Jun 17 11:52:21.612806 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 535/1072] 10.222.0.45 () {60 vars in 1158 bytes} [Fri Jun 17 11:52:21 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:52:42.769465 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:52:42.770233 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:52:42.774359 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-1b9a4644-4a47-4ba1-bac9-c46e1743fcc0 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2011359481", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-577758725", "security_groups": [{"name": "tempest-secgroup-smoke-47513298"}], "block_device_mapping_v2": [{"uuid": "b6ed3bdd-0ba7-4510-a7c7-1a7bf0c214e9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "816fb63a-6c1b-4743-8210-90f275943e2c"}]}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:52:42.898521 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.network.neutron [None req-1b9a4644-4a47-4ba1-bac9-c46e1743fcc0 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] validate_networks() for [('816fb63a-6c1b-4743-8210-90f275943e2c', None, None, None, None, None)] {{(pid=124845) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 11:52:43.285446 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-1b9a4644-4a47-4ba1-bac9-c46e1743fcc0 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Flavor limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 11:52:43.285868 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-1b9a4644-4a47-4ba1-bac9-c46e1743fcc0 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Image limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 11:52:43.286370 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-1b9a4644-4a47-4ba1-bac9-c46e1743fcc0 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Flavor pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 11:52:43.286777 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-1b9a4644-4a47-4ba1-bac9-c46e1743fcc0 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Image pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 11:52:43.287191 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-1b9a4644-4a47-4ba1-bac9-c46e1743fcc0 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 11:52:43.297071 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1b9a4644-4a47-4ba1-bac9-c46e1743fcc0 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:52:43.297525 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1b9a4644-4a47-4ba1-bac9-c46e1743fcc0 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:52:43.298322 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1b9a4644-4a47-4ba1-bac9-c46e1743fcc0 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:52:43.298758 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1b9a4644-4a47-4ba1-bac9-c46e1743fcc0 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:52:43.317160 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-1b9a4644-4a47-4ba1-bac9-c46e1743fcc0 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Getting quotas for project 17575f4a36b94fdfb338dd1ba516d58e. Resources: {'instances', 'ram', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 11:52:43.321246 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-1b9a4644-4a47-4ba1-bac9-c46e1743fcc0 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Getting quotas for user b5443b1aec1b414fad8bdd9f731ae7dc and project 17575f4a36b94fdfb338dd1ba516d58e. Resources: {'instances', 'ram', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 11:52:43.383091 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-1b9a4644-4a47-4ba1-bac9-c46e1743fcc0 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Going to run 1 instances... {{(pid=124845) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 11:52:43.385352 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-1b9a4644-4a47-4ba1-bac9-c46e1743fcc0 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: ba34be77-d3fd-48cd-b7dd-72a0544cc411] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b6ed3bdd-0ba7-4510-a7c7-1a7bf0c214e9',volume_size=None,volume_type=None)] {{(pid=124845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 11:52:43.929595 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-1b9a4644-4a47-4ba1-bac9-c46e1743fcc0 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.161972 Jun 17 11:52:43.930302 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 538/1073] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 17 11:52:42 2022] POST /compute/v2.1/servers => generated 404 bytes in 1163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 11:52:43.938907 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=4 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:52:43.939875 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:52:43.943920 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2aa2c2fd-85c8-48ac-a565-0857cfd6dfbf tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:52:43.944608 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-2aa2c2fd-85c8-48ac-a565-0857cfd6dfbf tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: ba34be77-d3fd-48cd-b7dd-72a0544cc411] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:52:44.004669 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2aa2c2fd-85c8-48ac-a565-0857cfd6dfbf tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:52:44.011768 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2aa2c2fd-85c8-48ac-a565-0857cfd6dfbf tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411" status: 200 len: 1094 microversion: 2.1 time: 0.074228 Jun 17 11:52:44.013397 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 536/1074] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:52:43 2022] GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:52:45.030149 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-fb1f810d-7484-47e4-8900-13a3781f96c4 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:52:45.030754 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-fb1f810d-7484-47e4-8900-13a3781f96c4 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: ba34be77-d3fd-48cd-b7dd-72a0544cc411] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:52:45.083748 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-fb1f810d-7484-47e4-8900-13a3781f96c4 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:52:45.091459 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-fb1f810d-7484-47e4-8900-13a3781f96c4 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411" status: 200 len: 1094 microversion: 2.1 time: 0.065876 Jun 17 11:52:45.092175 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 539/1075] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:52:45 2022] GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:52:46.110691 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6408d2fe-7642-480d-9a59-700323a2ad59 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:52:46.111691 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-6408d2fe-7642-480d-9a59-700323a2ad59 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: ba34be77-d3fd-48cd-b7dd-72a0544cc411] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:52:46.122720 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6408d2fe-7642-480d-9a59-700323a2ad59 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:52:46.123356 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6408d2fe-7642-480d-9a59-700323a2ad59 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:52:46.124320 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6408d2fe-7642-480d-9a59-700323a2ad59 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:52:46.124708 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6408d2fe-7642-480d-9a59-700323a2ad59 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:52:46.192914 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-6408d2fe-7642-480d-9a59-700323a2ad59 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:52:46.201956 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-6408d2fe-7642-480d-9a59-700323a2ad59 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411" status: 200 len: 1192 microversion: 2.1 time: 0.096152 Jun 17 11:52:46.202515 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 537/1076] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:52:46 2022] GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411 => generated 1192 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:52:47.221739 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-cca72438-f0ba-4db2-b526-a89d7c308a65 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:52:47.222311 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-cca72438-f0ba-4db2-b526-a89d7c308a65 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: ba34be77-d3fd-48cd-b7dd-72a0544cc411] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:52:47.229160 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cca72438-f0ba-4db2-b526-a89d7c308a65 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:52:47.229912 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cca72438-f0ba-4db2-b526-a89d7c308a65 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:52:47.230706 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cca72438-f0ba-4db2-b526-a89d7c308a65 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:52:47.231149 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cca72438-f0ba-4db2-b526-a89d7c308a65 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:52:47.312110 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-cca72438-f0ba-4db2-b526-a89d7c308a65 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:52:47.320101 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-cca72438-f0ba-4db2-b526-a89d7c308a65 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411" status: 200 len: 1210 microversion: 2.1 time: 0.102302 Jun 17 11:52:47.320690 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 540/1077] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:52:47 2022] GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411 => generated 1210 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:52:48.339326 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-fcebbbc7-1273-44a8-b0f5-10ca1a7da186 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:52:48.340900 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-fcebbbc7-1273-44a8-b0f5-10ca1a7da186 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: ba34be77-d3fd-48cd-b7dd-72a0544cc411] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:52:48.348604 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fcebbbc7-1273-44a8-b0f5-10ca1a7da186 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:52:48.349059 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fcebbbc7-1273-44a8-b0f5-10ca1a7da186 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:52:48.349881 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fcebbbc7-1273-44a8-b0f5-10ca1a7da186 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:52:48.350327 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fcebbbc7-1273-44a8-b0f5-10ca1a7da186 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:52:48.588628 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-fcebbbc7-1273-44a8-b0f5-10ca1a7da186 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:52:48.602678 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-fcebbbc7-1273-44a8-b0f5-10ca1a7da186 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411" status: 200 len: 1276 microversion: 2.1 time: 0.267050 Jun 17 11:52:48.603783 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 538/1078] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:52:48 2022] GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411 => generated 1276 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:52:48.828189 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-15e446ad-f34a-4a2f-b4cd-852058ff44a6 req-28e73575-9c0d-477a-9d15-3e5d548e0d67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba34be77-d3fd-48cd-b7dd-72a0544cc411", "tag": "cca2c977-5ab7-473e-855c-64184d4379a9"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:52:48.857288 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-15e446ad-f34a-4a2f-b4cd-852058ff44a6 req-28e73575-9c0d-477a-9d15-3e5d548e0d67 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:52:48.858114 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-15e446ad-f34a-4a2f-b4cd-852058ff44a6 req-28e73575-9c0d-477a-9d15-3e5d548e0d67 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:52:48.878012 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-15e446ad-f34a-4a2f-b4cd-852058ff44a6 req-28e73575-9c0d-477a-9d15-3e5d548e0d67 service nova] Creating event network-changed:cca2c977-5ab7-473e-855c-64184d4379a9 for instance ba34be77-d3fd-48cd-b7dd-72a0544cc411 on hv-cinder-83716 Jun 17 11:52:48.884199 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-15e446ad-f34a-4a2f-b4cd-852058ff44a6 req-28e73575-9c0d-477a-9d15-3e5d548e0d67 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062251 Jun 17 11:52:48.895944 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 541/1079] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:52:49.624100 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-21df2746-b8ab-49d4-ad54-c8f74ff9eb60 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:52:49.625031 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-21df2746-b8ab-49d4-ad54-c8f74ff9eb60 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: ba34be77-d3fd-48cd-b7dd-72a0544cc411] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:52:49.632772 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-21df2746-b8ab-49d4-ad54-c8f74ff9eb60 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:52:49.633233 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-21df2746-b8ab-49d4-ad54-c8f74ff9eb60 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:52:49.634029 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-21df2746-b8ab-49d4-ad54-c8f74ff9eb60 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:52:49.634481 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-21df2746-b8ab-49d4-ad54-c8f74ff9eb60 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:52:49.973364 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-21df2746-b8ab-49d4-ad54-c8f74ff9eb60 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:52:49.973364 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-21df2746-b8ab-49d4-ad54-c8f74ff9eb60 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411" status: 200 len: 1264 microversion: 2.1 time: 0.351900 Jun 17 11:52:49.973364 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 539/1080] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:52:49 2022] GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411 => generated 1264 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:52:50.990194 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-cd1d2742-826a-4bf7-9826-12f0ad7e8564 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:52:50.990816 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-cd1d2742-826a-4bf7-9826-12f0ad7e8564 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: ba34be77-d3fd-48cd-b7dd-72a0544cc411] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:52:50.998732 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cd1d2742-826a-4bf7-9826-12f0ad7e8564 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:52:50.999180 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cd1d2742-826a-4bf7-9826-12f0ad7e8564 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:52:50.999998 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cd1d2742-826a-4bf7-9826-12f0ad7e8564 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:52:51.000479 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cd1d2742-826a-4bf7-9826-12f0ad7e8564 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:52:51.144354 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-cd1d2742-826a-4bf7-9826-12f0ad7e8564 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:52:51.151982 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-cd1d2742-826a-4bf7-9826-12f0ad7e8564 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411" status: 200 len: 1264 microversion: 2.1 time: 0.166372 Jun 17 11:52:51.152548 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 542/1081] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:52:50 2022] GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:52:52.172978 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ae87d0f4-75c4-4525-b2b2-482b2945a6cc tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:52:52.173658 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ae87d0f4-75c4-4525-b2b2-482b2945a6cc tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: ba34be77-d3fd-48cd-b7dd-72a0544cc411] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:52:52.180577 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ae87d0f4-75c4-4525-b2b2-482b2945a6cc tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:52:52.181036 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ae87d0f4-75c4-4525-b2b2-482b2945a6cc tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:52:52.181840 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ae87d0f4-75c4-4525-b2b2-482b2945a6cc tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:52:52.182305 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ae87d0f4-75c4-4525-b2b2-482b2945a6cc tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:52:52.320901 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ae87d0f4-75c4-4525-b2b2-482b2945a6cc tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:52:52.329134 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ae87d0f4-75c4-4525-b2b2-482b2945a6cc tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411" status: 200 len: 1264 microversion: 2.1 time: 0.160275 Jun 17 11:52:52.330024 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 540/1082] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:52:52 2022] GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:52:53.347677 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-7df96e9c-9772-4a99-816a-d51415907b68 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:52:53.348346 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-7df96e9c-9772-4a99-816a-d51415907b68 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: ba34be77-d3fd-48cd-b7dd-72a0544cc411] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:52:53.350768 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:52:53.355828 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7df96e9c-9772-4a99-816a-d51415907b68 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:52:53.363083 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7df96e9c-9772-4a99-816a-d51415907b68 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:52:53.363083 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7df96e9c-9772-4a99-816a-d51415907b68 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:52:53.363083 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7df96e9c-9772-4a99-816a-d51415907b68 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:52:53.497884 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-7df96e9c-9772-4a99-816a-d51415907b68 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:52:53.505822 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-7df96e9c-9772-4a99-816a-d51415907b68 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411" status: 200 len: 1264 microversion: 2.1 time: 0.162113 Jun 17 11:52:53.506387 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 543/1083] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:52:53 2022] GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:52:54.523491 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-59765694-6875-49e0-93bd-23c106c3492c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:52:54.524097 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-59765694-6875-49e0-93bd-23c106c3492c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: ba34be77-d3fd-48cd-b7dd-72a0544cc411] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:52:54.531027 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-59765694-6875-49e0-93bd-23c106c3492c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:52:54.531508 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-59765694-6875-49e0-93bd-23c106c3492c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:52:54.532292 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-59765694-6875-49e0-93bd-23c106c3492c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:52:54.532733 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-59765694-6875-49e0-93bd-23c106c3492c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:52:54.682577 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-59765694-6875-49e0-93bd-23c106c3492c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:52:54.690687 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-59765694-6875-49e0-93bd-23c106c3492c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411" status: 200 len: 1264 microversion: 2.1 time: 0.171244 Jun 17 11:52:54.691910 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 541/1084] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:52:54 2022] GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:52:55.707398 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-250f7473-b38a-473d-acb9-700c47eb7b15 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:52:55.708460 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-250f7473-b38a-473d-acb9-700c47eb7b15 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: ba34be77-d3fd-48cd-b7dd-72a0544cc411] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:52:55.711800 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=8 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:52:55.715360 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-250f7473-b38a-473d-acb9-700c47eb7b15 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:52:55.715847 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-250f7473-b38a-473d-acb9-700c47eb7b15 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:52:55.716720 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-250f7473-b38a-473d-acb9-700c47eb7b15 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:52:55.717159 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-250f7473-b38a-473d-acb9-700c47eb7b15 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:52:55.857724 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-250f7473-b38a-473d-acb9-700c47eb7b15 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:52:55.865270 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-250f7473-b38a-473d-acb9-700c47eb7b15 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411" status: 200 len: 1264 microversion: 2.1 time: 0.161912 Jun 17 11:52:55.865834 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 544/1085] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:52:55 2022] GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:52:56.883019 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8aa61cd5-e5bc-4337-bb4c-c78e7195be9c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:52:56.883660 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-8aa61cd5-e5bc-4337-bb4c-c78e7195be9c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: ba34be77-d3fd-48cd-b7dd-72a0544cc411] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:52:56.885927 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=2 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:52:56.891721 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8aa61cd5-e5bc-4337-bb4c-c78e7195be9c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:52:56.892179 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8aa61cd5-e5bc-4337-bb4c-c78e7195be9c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:52:56.893033 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8aa61cd5-e5bc-4337-bb4c-c78e7195be9c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:52:56.893399 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8aa61cd5-e5bc-4337-bb4c-c78e7195be9c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:52:57.039783 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-8aa61cd5-e5bc-4337-bb4c-c78e7195be9c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:52:57.047631 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-8aa61cd5-e5bc-4337-bb4c-c78e7195be9c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411" status: 200 len: 1264 microversion: 2.1 time: 0.168783 Jun 17 11:52:57.048190 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 542/1086] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:52:56 2022] GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:52:58.068731 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-3cc3a06c-35d1-463f-ac9a-385aaf10107c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:52:58.069342 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-3cc3a06c-35d1-463f-ac9a-385aaf10107c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: ba34be77-d3fd-48cd-b7dd-72a0544cc411] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:52:58.076802 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3cc3a06c-35d1-463f-ac9a-385aaf10107c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:52:58.077254 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3cc3a06c-35d1-463f-ac9a-385aaf10107c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:52:58.078036 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3cc3a06c-35d1-463f-ac9a-385aaf10107c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:52:58.078481 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3cc3a06c-35d1-463f-ac9a-385aaf10107c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:52:58.224642 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-3cc3a06c-35d1-463f-ac9a-385aaf10107c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:52:58.232840 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-3cc3a06c-35d1-463f-ac9a-385aaf10107c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411" status: 200 len: 1264 microversion: 2.1 time: 0.168155 Jun 17 11:52:58.233456 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 545/1087] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:52:58 2022] GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:52:59.249415 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-cf72dc23-85b9-4cbe-a989-e77b1f5e2680 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:52:59.250084 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-cf72dc23-85b9-4cbe-a989-e77b1f5e2680 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: ba34be77-d3fd-48cd-b7dd-72a0544cc411] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:52:59.258375 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cf72dc23-85b9-4cbe-a989-e77b1f5e2680 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:52:59.258885 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cf72dc23-85b9-4cbe-a989-e77b1f5e2680 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:52:59.259925 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cf72dc23-85b9-4cbe-a989-e77b1f5e2680 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:52:59.260383 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cf72dc23-85b9-4cbe-a989-e77b1f5e2680 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:52:59.401317 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-cf72dc23-85b9-4cbe-a989-e77b1f5e2680 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:52:59.410299 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-cf72dc23-85b9-4cbe-a989-e77b1f5e2680 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411" status: 200 len: 1264 microversion: 2.1 time: 0.164789 Jun 17 11:52:59.410897 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 543/1088] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:52:59 2022] GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:53:00.428622 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-154a61b2-fa5c-4625-87be-6b7d92e92350 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:53:00.429303 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-154a61b2-fa5c-4625-87be-6b7d92e92350 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: ba34be77-d3fd-48cd-b7dd-72a0544cc411] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:53:00.436745 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-154a61b2-fa5c-4625-87be-6b7d92e92350 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:53:00.437195 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-154a61b2-fa5c-4625-87be-6b7d92e92350 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:53:00.437967 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-154a61b2-fa5c-4625-87be-6b7d92e92350 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:53:00.438434 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-154a61b2-fa5c-4625-87be-6b7d92e92350 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:53:00.578870 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-154a61b2-fa5c-4625-87be-6b7d92e92350 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:53:00.586355 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-154a61b2-fa5c-4625-87be-6b7d92e92350 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411" status: 200 len: 1264 microversion: 2.1 time: 0.161798 Jun 17 11:53:00.586922 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 546/1089] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:53:00 2022] GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:53:01.358034 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-b6d14163-8ecc-4192-87c0-18b5d7ec1029 req-a7c223e0-1b83-49b3-906d-5062208fe439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba34be77-d3fd-48cd-b7dd-72a0544cc411", "name": "network-vif-plugged", "status": "completed", "tag": "cca2c977-5ab7-473e-855c-64184d4379a9"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:53:01.366733 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-b6d14163-8ecc-4192-87c0-18b5d7ec1029 req-a7c223e0-1b83-49b3-906d-5062208fe439 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:53:01.377681 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-b6d14163-8ecc-4192-87c0-18b5d7ec1029 req-a7c223e0-1b83-49b3-906d-5062208fe439 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:53:01.380070 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-b6d14163-8ecc-4192-87c0-18b5d7ec1029 req-a7c223e0-1b83-49b3-906d-5062208fe439 service nova] Creating event network-vif-plugged:cca2c977-5ab7-473e-855c-64184d4379a9 for instance ba34be77-d3fd-48cd-b7dd-72a0544cc411 on hv-cinder-83716 Jun 17 11:53:01.386387 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-b6d14163-8ecc-4192-87c0-18b5d7ec1029 req-a7c223e0-1b83-49b3-906d-5062208fe439 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124524 Jun 17 11:53:01.387327 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 544/1090] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:53:01.603476 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-868dab0e-4e24-47b2-8a9a-4c7785eee52d tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:53:01.604082 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-868dab0e-4e24-47b2-8a9a-4c7785eee52d tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: ba34be77-d3fd-48cd-b7dd-72a0544cc411] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:53:01.611615 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-868dab0e-4e24-47b2-8a9a-4c7785eee52d tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:53:01.612070 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-868dab0e-4e24-47b2-8a9a-4c7785eee52d tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:53:01.612846 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-868dab0e-4e24-47b2-8a9a-4c7785eee52d tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:53:01.613277 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-868dab0e-4e24-47b2-8a9a-4c7785eee52d tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:53:01.749938 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-868dab0e-4e24-47b2-8a9a-4c7785eee52d tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:53:01.758080 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-868dab0e-4e24-47b2-8a9a-4c7785eee52d tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411" status: 200 len: 1264 microversion: 2.1 time: 0.158605 Jun 17 11:53:01.758674 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 547/1091] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:53:01 2022] GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:53:02.777384 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-fc9c0030-78a2-448b-a70b-96a29a2035f8 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:53:02.778683 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-fc9c0030-78a2-448b-a70b-96a29a2035f8 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: ba34be77-d3fd-48cd-b7dd-72a0544cc411] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:53:02.785193 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fc9c0030-78a2-448b-a70b-96a29a2035f8 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:53:02.785687 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fc9c0030-78a2-448b-a70b-96a29a2035f8 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:53:02.786504 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fc9c0030-78a2-448b-a70b-96a29a2035f8 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:53:02.786942 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fc9c0030-78a2-448b-a70b-96a29a2035f8 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:53:02.931976 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-fc9c0030-78a2-448b-a70b-96a29a2035f8 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:53:02.939786 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-fc9c0030-78a2-448b-a70b-96a29a2035f8 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411" status: 200 len: 1264 microversion: 2.1 time: 0.167249 Jun 17 11:53:02.940386 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 545/1092] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:53:02 2022] GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:53:03.957735 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-801436ef-cb83-4690-9200-4b2fb04ae229 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:53:03.958351 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-801436ef-cb83-4690-9200-4b2fb04ae229 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: ba34be77-d3fd-48cd-b7dd-72a0544cc411] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:53:03.966412 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-801436ef-cb83-4690-9200-4b2fb04ae229 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:53:03.967000 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-801436ef-cb83-4690-9200-4b2fb04ae229 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:53:03.967848 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-801436ef-cb83-4690-9200-4b2fb04ae229 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:53:03.968305 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-801436ef-cb83-4690-9200-4b2fb04ae229 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:53:04.112776 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-801436ef-cb83-4690-9200-4b2fb04ae229 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:53:04.120503 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-801436ef-cb83-4690-9200-4b2fb04ae229 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411" status: 200 len: 1450 microversion: 2.1 time: 0.166822 Jun 17 11:53:04.121073 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 548/1093] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:53:03 2022] GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411 => generated 1450 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:53:04.138219 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4bfc4edd-7cb0-4605-b4dd-c1e1e00b183f tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:53:04.138919 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4bfc4edd-7cb0-4605-b4dd-c1e1e00b183f tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: ba34be77-d3fd-48cd-b7dd-72a0544cc411] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:53:04.145662 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4bfc4edd-7cb0-4605-b4dd-c1e1e00b183f tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:53:04.146217 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4bfc4edd-7cb0-4605-b4dd-c1e1e00b183f tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:53:04.146993 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4bfc4edd-7cb0-4605-b4dd-c1e1e00b183f tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:53:04.147465 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4bfc4edd-7cb0-4605-b4dd-c1e1e00b183f tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:53:04.289465 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4bfc4edd-7cb0-4605-b4dd-c1e1e00b183f tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:53:04.297662 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4bfc4edd-7cb0-4605-b4dd-c1e1e00b183f tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411" status: 200 len: 1450 microversion: 2.1 time: 0.163780 Jun 17 11:53:04.298253 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 546/1094] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:53:04 2022] GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411 => generated 1450 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:53:06.966161 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-815c688b-a480-4e24-92f8-1e983a45b809 req-9704043d-5448-4821-ab63-f2e453294ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba34be77-d3fd-48cd-b7dd-72a0544cc411", "tag": "cca2c977-5ab7-473e-855c-64184d4379a9"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:53:06.974899 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-815c688b-a480-4e24-92f8-1e983a45b809 req-9704043d-5448-4821-ab63-f2e453294ce0 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:53:06.975357 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-815c688b-a480-4e24-92f8-1e983a45b809 req-9704043d-5448-4821-ab63-f2e453294ce0 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:53:06.988125 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-815c688b-a480-4e24-92f8-1e983a45b809 req-9704043d-5448-4821-ab63-f2e453294ce0 service nova] Creating event network-changed:cca2c977-5ab7-473e-855c-64184d4379a9 for instance ba34be77-d3fd-48cd-b7dd-72a0544cc411 on hv-cinder-83716 Jun 17 11:53:06.993290 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-815c688b-a480-4e24-92f8-1e983a45b809 req-9704043d-5448-4821-ab63-f2e453294ce0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127440 Jun 17 11:53:06.993895 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 549/1095] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:54:25.308621 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 11:54:25.309332 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Fri Jun 17 11:54:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 11:55:04.477533 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=24 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:55:04.478325 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=56 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:55:04.482246 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6ac633c2-d017-46d2-84a8-e176c4fb9ed0 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:55:04.482744 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-6ac633c2-d017-46d2-84a8-e176c4fb9ed0 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: ba34be77-d3fd-48cd-b7dd-72a0544cc411] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:55:04.488633 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6ac633c2-d017-46d2-84a8-e176c4fb9ed0 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:04.508611 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6ac633c2-d017-46d2-84a8-e176c4fb9ed0 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:04.508611 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6ac633c2-d017-46d2-84a8-e176c4fb9ed0 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:04.508611 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6ac633c2-d017-46d2-84a8-e176c4fb9ed0 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:04.515963 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-6ac633c2-d017-46d2-84a8-e176c4fb9ed0 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: ba34be77-d3fd-48cd-b7dd-72a0544cc411] Going to try to terminate instance {{(pid=124844) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 11:55:04.830684 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-6ac633c2-d017-46d2-84a8-e176c4fb9ed0 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411" status: 204 len: 0 microversion: 2.1 time: 0.355184 Jun 17 11:55:04.831743 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 547/1096] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 17 11:55:04 2022] DELETE /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 11:55:04.839350 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2cc8925f-2f6a-4337-b29f-a9f1c93ffd7d] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 17 11:55:04.840109 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:55:04.840754 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=54 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:55:04.845187 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9f9f906f-11c7-4753-8665-673a1bb22db3 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:55:04.845902 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9f9f906f-11c7-4753-8665-673a1bb22db3 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: ba34be77-d3fd-48cd-b7dd-72a0544cc411] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:55:04.853495 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9f9f906f-11c7-4753-8665-673a1bb22db3 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:04.854056 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9f9f906f-11c7-4753-8665-673a1bb22db3 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:04.855006 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9f9f906f-11c7-4753-8665-673a1bb22db3 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:04.855669 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9f9f906f-11c7-4753-8665-673a1bb22db3 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:04.998336 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9f9f906f-11c7-4753-8665-673a1bb22db3 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:55:05.006301 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9f9f906f-11c7-4753-8665-673a1bb22db3 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411" status: 200 len: 1575 microversion: 2.1 time: 0.168802 Jun 17 11:55:05.006876 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 550/1097] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:55:04 2022] GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411 => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:55:06.025377 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-458ebe5f-71a6-4271-a47d-07b4163ce3d5 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:55:06.026134 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-458ebe5f-71a6-4271-a47d-07b4163ce3d5 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: ba34be77-d3fd-48cd-b7dd-72a0544cc411] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:55:06.032884 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-458ebe5f-71a6-4271-a47d-07b4163ce3d5 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:06.033341 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-458ebe5f-71a6-4271-a47d-07b4163ce3d5 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:06.034120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-458ebe5f-71a6-4271-a47d-07b4163ce3d5 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:06.034561 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-458ebe5f-71a6-4271-a47d-07b4163ce3d5 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:06.171885 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-458ebe5f-71a6-4271-a47d-07b4163ce3d5 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:55:06.179500 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-458ebe5f-71a6-4271-a47d-07b4163ce3d5 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411" status: 200 len: 1575 microversion: 2.1 time: 0.158389 Jun 17 11:55:06.180080 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 548/1098] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:55:06 2022] GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:55:07.196389 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-06d52aea-fcc7-4a9d-a926-7921d771f7f5 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:55:07.196953 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-06d52aea-fcc7-4a9d-a926-7921d771f7f5 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: ba34be77-d3fd-48cd-b7dd-72a0544cc411] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:55:07.205177 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-06d52aea-fcc7-4a9d-a926-7921d771f7f5 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:07.205624 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-06d52aea-fcc7-4a9d-a926-7921d771f7f5 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:07.206387 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-06d52aea-fcc7-4a9d-a926-7921d771f7f5 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:07.206818 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-06d52aea-fcc7-4a9d-a926-7921d771f7f5 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:07.213354 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO oslo.messaging._drivers.impl_rabbit [-] [2cc8925f-2f6a-4337-b29f-a9f1c93ffd7d] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 59716. Jun 17 11:55:07.435811 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-06d52aea-fcc7-4a9d-a926-7921d771f7f5 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:55:07.443609 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-06d52aea-fcc7-4a9d-a926-7921d771f7f5 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411" status: 200 len: 1575 microversion: 2.1 time: 0.251699 Jun 17 11:55:07.444187 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 551/1099] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:55:07 2022] GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411 => generated 1575 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:55:07.656969 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-1beaece2-1806-4dd8-93b4-51cffb35f16c req-961be639-88b4-4b36-83b5-033f76e51fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba34be77-d3fd-48cd-b7dd-72a0544cc411", "name": "network-vif-deleted", "tag": "cca2c977-5ab7-473e-855c-64184d4379a9"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:55:07.666278 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-1beaece2-1806-4dd8-93b4-51cffb35f16c req-961be639-88b4-4b36-83b5-033f76e51fb4 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:07.666732 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-1beaece2-1806-4dd8-93b4-51cffb35f16c req-961be639-88b4-4b36-83b5-033f76e51fb4 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:07.678749 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-1beaece2-1806-4dd8-93b4-51cffb35f16c req-961be639-88b4-4b36-83b5-033f76e51fb4 service nova] Creating event network-vif-deleted:cca2c977-5ab7-473e-855c-64184d4379a9 for instance ba34be77-d3fd-48cd-b7dd-72a0544cc411 on hv-cinder-83716 Jun 17 11:55:07.685301 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-1beaece2-1806-4dd8-93b4-51cffb35f16c req-961be639-88b4-4b36-83b5-033f76e51fb4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032094 Jun 17 11:55:07.686107 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 549/1100] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:55:08.462701 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-78e6c561-92eb-4442-add4-f1a39a466197 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:55:08.463517 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-78e6c561-92eb-4442-add4-f1a39a466197 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: ba34be77-d3fd-48cd-b7dd-72a0544cc411] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:55:08.471476 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-78e6c561-92eb-4442-add4-f1a39a466197 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:08.471928 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-78e6c561-92eb-4442-add4-f1a39a466197 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:08.473050 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-78e6c561-92eb-4442-add4-f1a39a466197 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:08.473536 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-78e6c561-92eb-4442-add4-f1a39a466197 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:08.512955 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-78e6c561-92eb-4442-add4-f1a39a466197 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:08.515479 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-78e6c561-92eb-4442-add4-f1a39a466197 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:08.515479 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-78e6c561-92eb-4442-add4-f1a39a466197 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lazy-loading 'fault' on Instance uuid ba34be77-d3fd-48cd-b7dd-72a0544cc411 {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:55:08.562874 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-78e6c561-92eb-4442-add4-f1a39a466197 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:55:08.575177 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-78e6c561-92eb-4442-add4-f1a39a466197 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411" status: 200 len: 1230 microversion: 2.1 time: 0.116458 Jun 17 11:55:08.575177 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 552/1101] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:55:08 2022] GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411 => generated 1230 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:55:09.592477 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-0f8f2028-1469-4a7f-a990-34e0c1bc890e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:55:09.593185 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-0f8f2028-1469-4a7f-a990-34e0c1bc890e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: ba34be77-d3fd-48cd-b7dd-72a0544cc411] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:55:09.599542 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0f8f2028-1469-4a7f-a990-34e0c1bc890e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:09.600039 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0f8f2028-1469-4a7f-a990-34e0c1bc890e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:09.600814 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0f8f2028-1469-4a7f-a990-34e0c1bc890e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:09.601294 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0f8f2028-1469-4a7f-a990-34e0c1bc890e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:09.615010 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-0f8f2028-1469-4a7f-a990-34e0c1bc890e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] HTTP exception thrown: Instance ba34be77-d3fd-48cd-b7dd-72a0544cc411 could not be found. Jun 17 11:55:09.616758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-0f8f2028-1469-4a7f-a990-34e0c1bc890e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Request method failure captured: Jun 17 11:55:09.616758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: request: GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411 HTTP/1.1 Jun 17 11:55:09.616758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept: application/json Jun 17 11:55:09.616758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jun 17 11:55:09.616758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Connection: close Jun 17 11:55:09.616758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jun 17 11:55:09.616758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jun 17 11:55:09.616758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Host: 10.222.0.45 Jun 17 11:55:09.616758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jun 17 11:55:09.616758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jun 17 11:55:09.616758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABirGru0g_jcRc97gbpYX7yD5pv3n9CQmYO9kp27_4ftc3zkMRnxXRSOJ0BmcaaO-12FY-IwF-tlKbKkJiQt4iCv8O2NEc2KTIxlYdXk0GUSf3nD_LV2fde-KwM8V733p8BsJra8d5wq58gQbYZv5mhRWg77fa-rd2vlKnXLpsCtxg-Xv4 Jun 17 11:55:09.616758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jun 17 11:55:09.616758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jun 17 11:55:09.616758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jun 17 11:55:09.616758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jun 17 11:55:09.616758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jun 17 11:55:09.616758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jun 17 11:55:09.616758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Id: 17575f4a36b94fdfb338dd1ba516d58e Jun 17 11:55:09.616758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-TestVolumeBootPattern-704818079 Jun 17 11:55:09.616758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Role: member,reader Jun 17 11:55:09.616758 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Roles: member,reader Jun 17 11:55:09.618330 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/17575f4a36b94fdfb338dd1ba516d58e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_17575f4a36b94fdfb338dd1ba516d58e", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/17575f4a36b94fdfb338dd1ba516d58e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/17575f4a36b94fdfb338dd1ba516d58e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:55:09.618330 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-TestVolumeBootPattern-704818079 Jun 17 11:55:09.618330 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Id: 17575f4a36b94fdfb338dd1ba516d58e Jun 17 11:55:09.618330 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-TestVolumeBootPattern-704818079 Jun 17 11:55:09.618330 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User: tempest-TestVolumeBootPattern-704818079-project Jun 17 11:55:09.618330 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jun 17 11:55:09.618330 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jun 17 11:55:09.618330 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Id: b5443b1aec1b414fad8bdd9f731ae7dc Jun 17 11:55:09.618330 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-TestVolumeBootPattern-704818079-project Jun 17 11:55:09.618330 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: method: > Jun 17 11:55:09.618330 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: exception: Instance ba34be77-d3fd-48cd-b7dd-72a0544cc411 could not be found. Jun 17 11:55:09.618330 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: action_args: {'id': 'ba34be77-d3fd-48cd-b7dd-72a0544cc411'} Jun 17 11:55:09.621745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:55:09.621745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:55:09.621745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:55:09.621745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:55:09.621745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:55:09.621745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:55:09.621745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:55:09.621745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:55:09.621745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:55:09.621745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:55:09.621745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba34be77-d3fd-48cd-b7dd-72a0544cc411 could not be found. Jun 17 11:55:09.621745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:55:09.621745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:55:09.621745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:55:09.621745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:55:09.621745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:55:09.621745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:55:09.621745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:55:09.621745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:55:09.621745 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:55:09.627784 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:55:09.627784 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 11:55:09.627784 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 11:55:09.627784 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:55:09.627784 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:55:09.627784 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:55:09.627784 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:55:09.627784 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba34be77-d3fd-48cd-b7dd-72a0544cc411 could not be found. Jun 17 11:55:09.627784 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:55:09.627784 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:55:09.627784 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:55:09.627784 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:55:09.627784 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:55:09.627784 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:55:09.627784 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:55:09.627784 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:55:09.627784 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba34be77-d3fd-48cd-b7dd-72a0544cc411 could not be found. Jun 17 11:55:09.627784 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:55:09.630604 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-0f8f2028-1469-4a7f-a990-34e0c1bc890e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Returning 404 to user: Instance ba34be77-d3fd-48cd-b7dd-72a0544cc411 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:55:09.630604 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-0f8f2028-1469-4a7f-a990-34e0c1bc890e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411" status: 404 len: 111 microversion: 2.1 time: 0.030942 Jun 17 11:55:09.630604 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 550/1102] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:55:09 2022] GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:55:09.671623 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-46b985d8-30cc-459a-a694-c89577cf815e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1876389504", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-577758725", "security_groups": [{"name": "tempest-secgroup-smoke-47513298"}], "block_device_mapping_v2": [{"uuid": "b6ed3bdd-0ba7-4510-a7c7-1a7bf0c214e9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "816fb63a-6c1b-4743-8210-90f275943e2c"}]}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:55:09.797890 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.network.neutron [None req-46b985d8-30cc-459a-a694-c89577cf815e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] validate_networks() for [('816fb63a-6c1b-4743-8210-90f275943e2c', None, None, None, None, None)] {{(pid=124845) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 11:55:10.236119 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-46b985d8-30cc-459a-a694-c89577cf815e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Flavor limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 11:55:10.236545 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-46b985d8-30cc-459a-a694-c89577cf815e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Image limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 11:55:10.237024 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-46b985d8-30cc-459a-a694-c89577cf815e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Flavor pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 11:55:10.237441 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-46b985d8-30cc-459a-a694-c89577cf815e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Image pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 11:55:10.237887 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-46b985d8-30cc-459a-a694-c89577cf815e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 11:55:10.247648 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-46b985d8-30cc-459a-a694-c89577cf815e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:10.248100 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-46b985d8-30cc-459a-a694-c89577cf815e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:10.248903 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-46b985d8-30cc-459a-a694-c89577cf815e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:10.249340 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-46b985d8-30cc-459a-a694-c89577cf815e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:10.266576 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-46b985d8-30cc-459a-a694-c89577cf815e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Getting quotas for project 17575f4a36b94fdfb338dd1ba516d58e. Resources: {'instances', 'ram', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 11:55:10.270589 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-46b985d8-30cc-459a-a694-c89577cf815e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Getting quotas for user b5443b1aec1b414fad8bdd9f731ae7dc and project 17575f4a36b94fdfb338dd1ba516d58e. Resources: {'instances', 'ram', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 11:55:10.329181 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-46b985d8-30cc-459a-a694-c89577cf815e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Going to run 1 instances... {{(pid=124845) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 11:55:10.331266 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-46b985d8-30cc-459a-a694-c89577cf815e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: f6ff4fa8-631c-4ff5-9737-13b5eb8292f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b6ed3bdd-0ba7-4510-a7c7-1a7bf0c214e9',volume_size=None,volume_type=None)] {{(pid=124845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 11:55:10.826761 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-46b985d8-30cc-459a-a694-c89577cf815e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.159563 Jun 17 11:55:10.827652 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 553/1103] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 17 11:55:09 2022] POST /compute/v2.1/servers => generated 404 bytes in 1161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 17 11:55:10.838164 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-fb3af4b3-8efe-4055-8370-c582aa29f2d2 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:55:10.838896 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-fb3af4b3-8efe-4055-8370-c582aa29f2d2 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: f6ff4fa8-631c-4ff5-9737-13b5eb8292f3] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:55:10.895276 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-fb3af4b3-8efe-4055-8370-c582aa29f2d2 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:55:10.902649 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-fb3af4b3-8efe-4055-8370-c582aa29f2d2 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3" status: 200 len: 1094 microversion: 2.1 time: 0.068994 Jun 17 11:55:10.912053 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 551/1104] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:55:10 2022] GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:55:11.919812 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-021b5416-3adf-4041-b2c8-5f71b291656e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:55:11.920446 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-021b5416-3adf-4041-b2c8-5f71b291656e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: f6ff4fa8-631c-4ff5-9737-13b5eb8292f3] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:55:11.927347 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-021b5416-3adf-4041-b2c8-5f71b291656e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:11.927836 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-021b5416-3adf-4041-b2c8-5f71b291656e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:11.928669 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-021b5416-3adf-4041-b2c8-5f71b291656e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:11.929114 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-021b5416-3adf-4041-b2c8-5f71b291656e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:11.991129 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-021b5416-3adf-4041-b2c8-5f71b291656e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:55:12.000001 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-021b5416-3adf-4041-b2c8-5f71b291656e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3" status: 200 len: 1144 microversion: 2.1 time: 0.083981 Jun 17 11:55:12.000587 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 554/1105] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:55:11 2022] GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3 => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:55:13.017748 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c36ba65e-9f64-4983-8ba3-4f543252e6df tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:55:13.018301 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c36ba65e-9f64-4983-8ba3-4f543252e6df tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: f6ff4fa8-631c-4ff5-9737-13b5eb8292f3] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:55:13.026868 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c36ba65e-9f64-4983-8ba3-4f543252e6df tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:13.027312 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c36ba65e-9f64-4983-8ba3-4f543252e6df tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:13.028094 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c36ba65e-9f64-4983-8ba3-4f543252e6df tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:13.028528 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c36ba65e-9f64-4983-8ba3-4f543252e6df tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:13.102256 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c36ba65e-9f64-4983-8ba3-4f543252e6df tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:55:13.112021 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c36ba65e-9f64-4983-8ba3-4f543252e6df tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3" status: 200 len: 1192 microversion: 2.1 time: 0.098165 Jun 17 11:55:13.112592 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 552/1106] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:55:13 2022] GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3 => generated 1192 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:55:14.130020 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2c761d3c-73f9-4272-9fce-32cb20c525be tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:55:14.130895 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2c761d3c-73f9-4272-9fce-32cb20c525be tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: f6ff4fa8-631c-4ff5-9737-13b5eb8292f3] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:55:14.138770 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2c761d3c-73f9-4272-9fce-32cb20c525be tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:14.139812 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2c761d3c-73f9-4272-9fce-32cb20c525be tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:14.140875 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2c761d3c-73f9-4272-9fce-32cb20c525be tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:14.141384 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2c761d3c-73f9-4272-9fce-32cb20c525be tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:14.302920 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2c761d3c-73f9-4272-9fce-32cb20c525be tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:55:14.312238 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2c761d3c-73f9-4272-9fce-32cb20c525be tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3" status: 200 len: 1276 microversion: 2.1 time: 0.186251 Jun 17 11:55:14.312830 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 555/1107] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:55:14 2022] GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3 => generated 1276 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:55:15.196452 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-cec4fc4e-88c7-465f-8a3b-ab274c7f9156 req-d07ceac3-be47-4b6f-af3d-8df25bd1b098 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6ff4fa8-631c-4ff5-9737-13b5eb8292f3", "tag": "92b10753-3cf1-4e2e-9257-638b27251c45"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:55:15.211304 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-cec4fc4e-88c7-465f-8a3b-ab274c7f9156 req-d07ceac3-be47-4b6f-af3d-8df25bd1b098 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:15.211818 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-cec4fc4e-88c7-465f-8a3b-ab274c7f9156 req-d07ceac3-be47-4b6f-af3d-8df25bd1b098 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:15.224863 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-cec4fc4e-88c7-465f-8a3b-ab274c7f9156 req-d07ceac3-be47-4b6f-af3d-8df25bd1b098 service nova] Creating event network-changed:92b10753-3cf1-4e2e-9257-638b27251c45 for instance f6ff4fa8-631c-4ff5-9737-13b5eb8292f3 on hv-cinder-83716 Jun 17 11:55:15.230425 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-cec4fc4e-88c7-465f-8a3b-ab274c7f9156 req-d07ceac3-be47-4b6f-af3d-8df25bd1b098 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046244 Jun 17 11:55:15.231057 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 553/1108] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:55:15.333048 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0e200a09-3caf-4faf-977d-c9c07361cbd1 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:55:15.338300 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0e200a09-3caf-4faf-977d-c9c07361cbd1 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: f6ff4fa8-631c-4ff5-9737-13b5eb8292f3] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:55:15.341744 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0e200a09-3caf-4faf-977d-c9c07361cbd1 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:15.342199 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0e200a09-3caf-4faf-977d-c9c07361cbd1 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:15.342979 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0e200a09-3caf-4faf-977d-c9c07361cbd1 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:15.343448 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0e200a09-3caf-4faf-977d-c9c07361cbd1 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:15.815798 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0e200a09-3caf-4faf-977d-c9c07361cbd1 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:55:15.823810 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0e200a09-3caf-4faf-977d-c9c07361cbd1 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3" status: 200 len: 1264 microversion: 2.1 time: 0.494676 Jun 17 11:55:15.824388 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 556/1109] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:55:15 2022] GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3 => generated 1264 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:55:16.844309 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e401ba02-17c2-4892-9c93-df55079740c3 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:55:16.845012 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e401ba02-17c2-4892-9c93-df55079740c3 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: f6ff4fa8-631c-4ff5-9737-13b5eb8292f3] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:55:16.851992 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e401ba02-17c2-4892-9c93-df55079740c3 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:16.852443 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e401ba02-17c2-4892-9c93-df55079740c3 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:16.861944 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e401ba02-17c2-4892-9c93-df55079740c3 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:16.861944 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e401ba02-17c2-4892-9c93-df55079740c3 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:16.997527 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e401ba02-17c2-4892-9c93-df55079740c3 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:55:17.006756 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e401ba02-17c2-4892-9c93-df55079740c3 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3" status: 200 len: 1264 microversion: 2.1 time: 0.169491 Jun 17 11:55:17.007333 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 554/1110] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:55:16 2022] GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:55:17.303082 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 11:55:17.303340 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Fri Jun 17 11:55:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 11:55:18.028782 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-87a9aa65-5938-4eba-9573-4124a4d49edd tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:55:18.029392 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-87a9aa65-5938-4eba-9573-4124a4d49edd tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: f6ff4fa8-631c-4ff5-9737-13b5eb8292f3] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:55:18.036326 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-87a9aa65-5938-4eba-9573-4124a4d49edd tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:18.036782 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-87a9aa65-5938-4eba-9573-4124a4d49edd tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:18.037652 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-87a9aa65-5938-4eba-9573-4124a4d49edd tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:18.038094 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-87a9aa65-5938-4eba-9573-4124a4d49edd tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:18.176321 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-87a9aa65-5938-4eba-9573-4124a4d49edd tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:55:18.184475 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-87a9aa65-5938-4eba-9573-4124a4d49edd tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3" status: 200 len: 1264 microversion: 2.1 time: 0.160203 Jun 17 11:55:18.185040 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 557/1111] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:55:18 2022] GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:55:19.201984 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c69f4330-118b-4b9b-b6cb-f90eda7034cc tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:55:19.202649 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c69f4330-118b-4b9b-b6cb-f90eda7034cc tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: f6ff4fa8-631c-4ff5-9737-13b5eb8292f3] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:55:19.209286 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c69f4330-118b-4b9b-b6cb-f90eda7034cc tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:19.209679 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c69f4330-118b-4b9b-b6cb-f90eda7034cc tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:19.210480 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c69f4330-118b-4b9b-b6cb-f90eda7034cc tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:19.210917 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c69f4330-118b-4b9b-b6cb-f90eda7034cc tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:19.348068 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c69f4330-118b-4b9b-b6cb-f90eda7034cc tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:55:19.355925 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c69f4330-118b-4b9b-b6cb-f90eda7034cc tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3" status: 200 len: 1264 microversion: 2.1 time: 0.158170 Jun 17 11:55:19.356490 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 555/1112] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:55:19 2022] GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:55:20.372865 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2d3c2836-6d71-4e8d-a86a-889f9bebe9ab tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:55:20.373510 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2d3c2836-6d71-4e8d-a86a-889f9bebe9ab tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: f6ff4fa8-631c-4ff5-9737-13b5eb8292f3] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:55:20.375871 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:55:20.376529 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=6 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:55:20.381613 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2d3c2836-6d71-4e8d-a86a-889f9bebe9ab tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:20.382063 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2d3c2836-6d71-4e8d-a86a-889f9bebe9ab tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:20.382827 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2d3c2836-6d71-4e8d-a86a-889f9bebe9ab tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:20.383262 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2d3c2836-6d71-4e8d-a86a-889f9bebe9ab tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:20.518823 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2d3c2836-6d71-4e8d-a86a-889f9bebe9ab tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:55:20.527091 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2d3c2836-6d71-4e8d-a86a-889f9bebe9ab tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3" status: 200 len: 1264 microversion: 2.1 time: 0.158030 Jun 17 11:55:20.527704 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 558/1113] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:55:20 2022] GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:55:21.544569 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-9ef396d0-f906-4cbd-b71c-007b5428a66e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:55:21.545319 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-9ef396d0-f906-4cbd-b71c-007b5428a66e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: f6ff4fa8-631c-4ff5-9737-13b5eb8292f3] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:55:21.547611 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=2 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:55:21.552526 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9ef396d0-f906-4cbd-b71c-007b5428a66e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:21.552981 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9ef396d0-f906-4cbd-b71c-007b5428a66e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:21.553757 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9ef396d0-f906-4cbd-b71c-007b5428a66e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:21.554206 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9ef396d0-f906-4cbd-b71c-007b5428a66e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:21.695164 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-9ef396d0-f906-4cbd-b71c-007b5428a66e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:55:21.702820 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-9ef396d0-f906-4cbd-b71c-007b5428a66e tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3" status: 200 len: 1264 microversion: 2.1 time: 0.162649 Jun 17 11:55:21.703415 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 556/1114] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:55:21 2022] GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:55:22.719777 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ba9cb87f-6d69-4e1e-842b-6426521f5e23 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:55:22.720400 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-ba9cb87f-6d69-4e1e-842b-6426521f5e23 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: f6ff4fa8-631c-4ff5-9737-13b5eb8292f3] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:55:22.727062 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ba9cb87f-6d69-4e1e-842b-6426521f5e23 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:22.727550 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ba9cb87f-6d69-4e1e-842b-6426521f5e23 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:22.728314 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ba9cb87f-6d69-4e1e-842b-6426521f5e23 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:22.728744 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ba9cb87f-6d69-4e1e-842b-6426521f5e23 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:22.865307 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ba9cb87f-6d69-4e1e-842b-6426521f5e23 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:55:22.873859 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-ba9cb87f-6d69-4e1e-842b-6426521f5e23 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3" status: 200 len: 1264 microversion: 2.1 time: 0.158081 Jun 17 11:55:22.874441 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 559/1115] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:55:22 2022] GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:55:23.891626 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-fb06a38b-4643-451a-b41a-38154140d069 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:55:23.892145 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-fb06a38b-4643-451a-b41a-38154140d069 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: f6ff4fa8-631c-4ff5-9737-13b5eb8292f3] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:55:23.898634 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fb06a38b-4643-451a-b41a-38154140d069 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:23.899078 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fb06a38b-4643-451a-b41a-38154140d069 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:23.899864 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fb06a38b-4643-451a-b41a-38154140d069 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:23.900301 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fb06a38b-4643-451a-b41a-38154140d069 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:24.039271 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-fb06a38b-4643-451a-b41a-38154140d069 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:55:24.047787 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-fb06a38b-4643-451a-b41a-38154140d069 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3" status: 200 len: 1264 microversion: 2.1 time: 0.160186 Jun 17 11:55:24.048358 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 557/1116] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:55:23 2022] GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:55:25.064181 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-5c541236-b651-4074-b49d-5f78b2c49de9 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:55:25.064795 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-5c541236-b651-4074-b49d-5f78b2c49de9 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: f6ff4fa8-631c-4ff5-9737-13b5eb8292f3] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:55:25.071321 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5c541236-b651-4074-b49d-5f78b2c49de9 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:25.071789 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5c541236-b651-4074-b49d-5f78b2c49de9 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:25.072543 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5c541236-b651-4074-b49d-5f78b2c49de9 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:25.072974 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5c541236-b651-4074-b49d-5f78b2c49de9 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:25.207638 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5c541236-b651-4074-b49d-5f78b2c49de9 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:55:25.216010 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-5c541236-b651-4074-b49d-5f78b2c49de9 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3" status: 200 len: 1264 microversion: 2.1 time: 0.155750 Jun 17 11:55:25.216581 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 560/1117] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:55:25 2022] GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:55:25.968957 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-296ad28b-2ff8-4232-8b25-b071e86efa62 req-b2ca6e85-b00b-4877-ad32-f0bb345a713d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6ff4fa8-631c-4ff5-9737-13b5eb8292f3", "name": "network-vif-plugged", "status": "completed", "tag": "92b10753-3cf1-4e2e-9257-638b27251c45"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:55:25.978070 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-296ad28b-2ff8-4232-8b25-b071e86efa62 req-b2ca6e85-b00b-4877-ad32-f0bb345a713d service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:25.978547 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-296ad28b-2ff8-4232-8b25-b071e86efa62 req-b2ca6e85-b00b-4877-ad32-f0bb345a713d service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:25.990399 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-296ad28b-2ff8-4232-8b25-b071e86efa62 req-b2ca6e85-b00b-4877-ad32-f0bb345a713d service nova] Creating event network-vif-plugged:92b10753-3cf1-4e2e-9257-638b27251c45 for instance f6ff4fa8-631c-4ff5-9737-13b5eb8292f3 on hv-cinder-83716 Jun 17 11:55:25.995780 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-296ad28b-2ff8-4232-8b25-b071e86efa62 req-b2ca6e85-b00b-4877-ad32-f0bb345a713d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032428 Jun 17 11:55:25.996404 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 558/1118] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:55:26.233183 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-03d96a8b-063e-4e82-92ad-4986801c17ad tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:55:26.233803 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-03d96a8b-063e-4e82-92ad-4986801c17ad tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: f6ff4fa8-631c-4ff5-9737-13b5eb8292f3] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:55:26.240476 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-03d96a8b-063e-4e82-92ad-4986801c17ad tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:26.250397 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-03d96a8b-063e-4e82-92ad-4986801c17ad tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:26.250397 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-03d96a8b-063e-4e82-92ad-4986801c17ad tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:26.250397 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-03d96a8b-063e-4e82-92ad-4986801c17ad tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:26.383274 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-03d96a8b-063e-4e82-92ad-4986801c17ad tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:55:26.392489 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-03d96a8b-063e-4e82-92ad-4986801c17ad tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3" status: 200 len: 1264 microversion: 2.1 time: 0.163368 Jun 17 11:55:26.393085 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 561/1119] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:55:26 2022] GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:55:27.410760 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-50b289f3-a7df-449e-9bd3-2d0348af1d17 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:55:27.411500 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-50b289f3-a7df-449e-9bd3-2d0348af1d17 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: f6ff4fa8-631c-4ff5-9737-13b5eb8292f3] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:55:27.417850 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-50b289f3-a7df-449e-9bd3-2d0348af1d17 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:27.418301 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-50b289f3-a7df-449e-9bd3-2d0348af1d17 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:27.419611 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-50b289f3-a7df-449e-9bd3-2d0348af1d17 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:27.420048 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-50b289f3-a7df-449e-9bd3-2d0348af1d17 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:27.555887 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-50b289f3-a7df-449e-9bd3-2d0348af1d17 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:55:27.564168 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-50b289f3-a7df-449e-9bd3-2d0348af1d17 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3" status: 200 len: 1264 microversion: 2.1 time: 0.158239 Jun 17 11:55:27.566239 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 559/1120] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:55:27 2022] GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:55:28.581448 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-724d235d-cf0b-4429-9453-c98e6b52fb75 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:55:28.582065 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-724d235d-cf0b-4429-9453-c98e6b52fb75 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: f6ff4fa8-631c-4ff5-9737-13b5eb8292f3] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:55:28.588929 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-724d235d-cf0b-4429-9453-c98e6b52fb75 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:28.589380 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-724d235d-cf0b-4429-9453-c98e6b52fb75 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:28.590175 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-724d235d-cf0b-4429-9453-c98e6b52fb75 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:28.591294 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-724d235d-cf0b-4429-9453-c98e6b52fb75 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:28.728076 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-724d235d-cf0b-4429-9453-c98e6b52fb75 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:55:28.736833 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-724d235d-cf0b-4429-9453-c98e6b52fb75 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3" status: 200 len: 1451 microversion: 2.1 time: 0.159318 Jun 17 11:55:28.737406 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 562/1121] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:55:28 2022] GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3 => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:55:28.753203 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a7f684a1-6998-4fec-8cfc-a997a66b4828 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:55:28.753816 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a7f684a1-6998-4fec-8cfc-a997a66b4828 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: f6ff4fa8-631c-4ff5-9737-13b5eb8292f3] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:55:28.760868 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a7f684a1-6998-4fec-8cfc-a997a66b4828 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:28.761326 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a7f684a1-6998-4fec-8cfc-a997a66b4828 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:28.762103 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a7f684a1-6998-4fec-8cfc-a997a66b4828 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:28.762812 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a7f684a1-6998-4fec-8cfc-a997a66b4828 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:28.896571 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a7f684a1-6998-4fec-8cfc-a997a66b4828 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:55:28.905224 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a7f684a1-6998-4fec-8cfc-a997a66b4828 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3" status: 200 len: 1451 microversion: 2.1 time: 0.155878 Jun 17 11:55:28.905799 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 560/1122] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:55:28 2022] GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:55:30.903023 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-6306d1c1-6d5e-4a58-82d7-6ded4874dc13 req-f00ce2e2-a2b0-40e0-9622-7f6e9b524596 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6ff4fa8-631c-4ff5-9737-13b5eb8292f3", "tag": "92b10753-3cf1-4e2e-9257-638b27251c45"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:55:30.911883 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-6306d1c1-6d5e-4a58-82d7-6ded4874dc13 req-f00ce2e2-a2b0-40e0-9622-7f6e9b524596 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:55:30.912328 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-6306d1c1-6d5e-4a58-82d7-6ded4874dc13 req-f00ce2e2-a2b0-40e0-9622-7f6e9b524596 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:55:30.923564 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-6306d1c1-6d5e-4a58-82d7-6ded4874dc13 req-f00ce2e2-a2b0-40e0-9622-7f6e9b524596 service nova] Creating event network-changed:92b10753-3cf1-4e2e-9257-638b27251c45 for instance f6ff4fa8-631c-4ff5-9737-13b5eb8292f3 on hv-cinder-83716 Jun 17 11:55:30.927106 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR oslo.messaging._drivers.impl_rabbit [req-6306d1c1-6d5e-4a58-82d7-6ded4874dc13 req-f00ce2e2-a2b0-40e0-9622-7f6e9b524596 service nova] [4938f4a4-0913-4634-917b-6d7e0bd87a74] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 17 11:55:31.935093 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO oslo.messaging._drivers.impl_rabbit [req-6306d1c1-6d5e-4a58-82d7-6ded4874dc13 req-f00ce2e2-a2b0-40e0-9622-7f6e9b524596 service nova] [4938f4a4-0913-4634-917b-6d7e0bd87a74] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 59800. Jun 17 11:55:31.939040 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-6306d1c1-6d5e-4a58-82d7-6ded4874dc13 req-f00ce2e2-a2b0-40e0-9622-7f6e9b524596 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.040056 Jun 17 11:55:31.939803 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 563/1123] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:56:09.368402 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 11:56:09.374598 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Fri Jun 17 11:56:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 11:57:06.775312 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:57:06.776112 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:57:06.780109 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-7137daa9-1299-411b-b204-cc9b31990862 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-314024625", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-577758725", "security_groups": [{"name": "tempest-secgroup-smoke-47513298"}], "block_device_mapping_v2": [{"uuid": "d77909e4-8cda-44a2-a924-e9be3450bf26", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "816fb63a-6c1b-4743-8210-90f275943e2c"}]}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:57:07.049613 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.network.neutron [None req-7137daa9-1299-411b-b204-cc9b31990862 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] validate_networks() for [('816fb63a-6c1b-4743-8210-90f275943e2c', None, None, None, None, None)] {{(pid=124844) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 11:57:07.489079 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-7137daa9-1299-411b-b204-cc9b31990862 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Flavor limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 11:57:07.490290 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-7137daa9-1299-411b-b204-cc9b31990862 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Image limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 11:57:07.490765 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-7137daa9-1299-411b-b204-cc9b31990862 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Flavor pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 11:57:07.491168 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-7137daa9-1299-411b-b204-cc9b31990862 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Image pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 11:57:07.491614 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-7137daa9-1299-411b-b204-cc9b31990862 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 11:57:07.500489 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7137daa9-1299-411b-b204-cc9b31990862 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:57:07.500938 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7137daa9-1299-411b-b204-cc9b31990862 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:57:07.501736 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7137daa9-1299-411b-b204-cc9b31990862 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:57:07.502175 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7137daa9-1299-411b-b204-cc9b31990862 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:57:07.518716 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-7137daa9-1299-411b-b204-cc9b31990862 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Getting quotas for project 17575f4a36b94fdfb338dd1ba516d58e. Resources: {'instances', 'ram', 'cores'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 11:57:07.522770 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-7137daa9-1299-411b-b204-cc9b31990862 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Getting quotas for user b5443b1aec1b414fad8bdd9f731ae7dc and project 17575f4a36b94fdfb338dd1ba516d58e. Resources: {'instances', 'ram', 'cores'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 11:57:07.579744 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7137daa9-1299-411b-b204-cc9b31990862 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Going to run 1 instances... {{(pid=124844) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 11:57:07.581831 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7137daa9-1299-411b-b204-cc9b31990862 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: c3c1c002-df03-4597-a5a9-69e90552d7c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d77909e4-8cda-44a2-a924-e9be3450bf26',volume_size=None,volume_type=None)] {{(pid=124844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 11:57:07.984660 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-7137daa9-1299-411b-b204-cc9b31990862 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.211074 Jun 17 11:57:07.987796 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 561/1124] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 17 11:57:06 2022] POST /compute/v2.1/servers => generated 404 bytes in 1215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 11:57:07.993995 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2cc8925f-2f6a-4337-b29f-a9f1c93ffd7d] AMQP server on 10.222.0.45:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 17 11:57:07.994594 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:57:07.995394 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=78 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:57:08.000001 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9bdf88a1-b573-442b-b449-f92c213f4dc3 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:57:08.002008 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9bdf88a1-b573-442b-b449-f92c213f4dc3 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: c3c1c002-df03-4597-a5a9-69e90552d7c4] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:57:08.116211 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9bdf88a1-b573-442b-b449-f92c213f4dc3 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:57:08.122955 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9bdf88a1-b573-442b-b449-f92c213f4dc3 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4" status: 200 len: 1093 microversion: 2.1 time: 0.131203 Jun 17 11:57:08.123550 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 564/1125] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:57:07 2022] GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4 => generated 1093 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:57:09.144090 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-95126c0f-cf7e-48a9-acfa-50d1270a334b tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:57:09.144712 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-95126c0f-cf7e-48a9-acfa-50d1270a334b tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: c3c1c002-df03-4597-a5a9-69e90552d7c4] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:57:09.152104 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-95126c0f-cf7e-48a9-acfa-50d1270a334b tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:57:09.152554 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-95126c0f-cf7e-48a9-acfa-50d1270a334b tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:57:09.153330 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-95126c0f-cf7e-48a9-acfa-50d1270a334b tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:57:09.153757 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-95126c0f-cf7e-48a9-acfa-50d1270a334b tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:57:09.216311 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-95126c0f-cf7e-48a9-acfa-50d1270a334b tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:57:09.223932 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-95126c0f-cf7e-48a9-acfa-50d1270a334b tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4" status: 200 len: 1143 microversion: 2.1 time: 0.084410 Jun 17 11:57:09.224491 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 562/1126] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:57:09 2022] GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4 => generated 1143 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:57:10.241535 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-3fa9d40c-cb5e-4724-a750-dccc34b66bd3 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:57:10.242166 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-3fa9d40c-cb5e-4724-a750-dccc34b66bd3 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: c3c1c002-df03-4597-a5a9-69e90552d7c4] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:57:10.251601 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3fa9d40c-cb5e-4724-a750-dccc34b66bd3 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:57:10.252046 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3fa9d40c-cb5e-4724-a750-dccc34b66bd3 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:57:10.252812 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3fa9d40c-cb5e-4724-a750-dccc34b66bd3 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:57:10.253251 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3fa9d40c-cb5e-4724-a750-dccc34b66bd3 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:57:10.260492 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO oslo.messaging._drivers.impl_rabbit [-] [2cc8925f-2f6a-4337-b29f-a9f1c93ffd7d] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 59890. Jun 17 11:57:10.327855 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-3fa9d40c-cb5e-4724-a750-dccc34b66bd3 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:57:10.336513 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-3fa9d40c-cb5e-4724-a750-dccc34b66bd3 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4" status: 200 len: 1199 microversion: 2.1 time: 0.099782 Jun 17 11:57:10.365409 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 565/1127] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:57:10 2022] GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4 => generated 1199 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:57:11.354462 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-29ff0f21-ee3c-45dd-ad8d-f9f6ee452627 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:57:11.355194 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-29ff0f21-ee3c-45dd-ad8d-f9f6ee452627 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: c3c1c002-df03-4597-a5a9-69e90552d7c4] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:57:11.362001 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-29ff0f21-ee3c-45dd-ad8d-f9f6ee452627 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:57:11.362509 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-29ff0f21-ee3c-45dd-ad8d-f9f6ee452627 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:57:11.363297 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-29ff0f21-ee3c-45dd-ad8d-f9f6ee452627 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:57:11.363766 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-29ff0f21-ee3c-45dd-ad8d-f9f6ee452627 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:57:11.612521 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-29ff0f21-ee3c-45dd-ad8d-f9f6ee452627 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:57:11.621131 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-29ff0f21-ee3c-45dd-ad8d-f9f6ee452627 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4" status: 200 len: 1275 microversion: 2.1 time: 0.271341 Jun 17 11:57:11.627345 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 563/1128] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:57:11 2022] GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4 => generated 1275 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:57:12.307702 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-4fdaa2c6-17ca-455c-a7ea-083a6f8c5f21 req-cc44f026-7314-48d7-9afe-844499e4af1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3c1c002-df03-4597-a5a9-69e90552d7c4", "tag": "b4d2b9e3-f7f6-445d-b9a4-b29e99e6440c"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:57:12.316016 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-4fdaa2c6-17ca-455c-a7ea-083a6f8c5f21 req-cc44f026-7314-48d7-9afe-844499e4af1a service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:57:12.316714 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-4fdaa2c6-17ca-455c-a7ea-083a6f8c5f21 req-cc44f026-7314-48d7-9afe-844499e4af1a service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:57:12.329857 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-4fdaa2c6-17ca-455c-a7ea-083a6f8c5f21 req-cc44f026-7314-48d7-9afe-844499e4af1a service nova] Creating event network-changed:b4d2b9e3-f7f6-445d-b9a4-b29e99e6440c for instance c3c1c002-df03-4597-a5a9-69e90552d7c4 on hv-cinder-83716 Jun 17 11:57:12.336300 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-4fdaa2c6-17ca-455c-a7ea-083a6f8c5f21 req-cc44f026-7314-48d7-9afe-844499e4af1a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100913 Jun 17 11:57:12.337344 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 566/1129] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:57:12.638561 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d7879ea4-660c-4504-9ecb-ad371a2296e6 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:57:12.639180 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d7879ea4-660c-4504-9ecb-ad371a2296e6 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: c3c1c002-df03-4597-a5a9-69e90552d7c4] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:57:12.645680 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d7879ea4-660c-4504-9ecb-ad371a2296e6 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:57:12.646234 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d7879ea4-660c-4504-9ecb-ad371a2296e6 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:57:12.647053 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d7879ea4-660c-4504-9ecb-ad371a2296e6 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:57:12.647528 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d7879ea4-660c-4504-9ecb-ad371a2296e6 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:57:12.809122 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d7879ea4-660c-4504-9ecb-ad371a2296e6 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:57:12.814990 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d7879ea4-660c-4504-9ecb-ad371a2296e6 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4" status: 200 len: 1263 microversion: 2.1 time: 0.180333 Jun 17 11:57:12.815643 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 564/1130] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:57:12 2022] GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4 => generated 1263 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:57:13.833588 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-7ffb570a-5232-4748-b136-3d8c64a9dce4 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:57:13.834927 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-7ffb570a-5232-4748-b136-3d8c64a9dce4 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: c3c1c002-df03-4597-a5a9-69e90552d7c4] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:57:13.841644 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7ffb570a-5232-4748-b136-3d8c64a9dce4 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:57:13.842170 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7ffb570a-5232-4748-b136-3d8c64a9dce4 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:57:13.842943 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7ffb570a-5232-4748-b136-3d8c64a9dce4 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:57:13.843404 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7ffb570a-5232-4748-b136-3d8c64a9dce4 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:57:13.983513 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-7ffb570a-5232-4748-b136-3d8c64a9dce4 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:57:13.992000 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-7ffb570a-5232-4748-b136-3d8c64a9dce4 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4" status: 200 len: 1263 microversion: 2.1 time: 0.163196 Jun 17 11:57:13.992584 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 567/1131] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:57:13 2022] GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4 => generated 1263 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:57:15.009287 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-57f9a0a9-efdf-46e2-868b-bd4ee78721c9 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:57:15.009863 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-57f9a0a9-efdf-46e2-868b-bd4ee78721c9 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: c3c1c002-df03-4597-a5a9-69e90552d7c4] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:57:15.016475 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-57f9a0a9-efdf-46e2-868b-bd4ee78721c9 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:57:15.016927 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-57f9a0a9-efdf-46e2-868b-bd4ee78721c9 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:57:15.017721 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-57f9a0a9-efdf-46e2-868b-bd4ee78721c9 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:57:15.018156 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-57f9a0a9-efdf-46e2-868b-bd4ee78721c9 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:57:15.149766 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-57f9a0a9-efdf-46e2-868b-bd4ee78721c9 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:57:15.157462 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-57f9a0a9-efdf-46e2-868b-bd4ee78721c9 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4" status: 200 len: 1263 microversion: 2.1 time: 0.152677 Jun 17 11:57:15.158033 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 565/1132] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:57:15 2022] GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:57:16.174816 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a14ed296-175b-49a6-824c-62c0c40362d8 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:57:16.175439 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a14ed296-175b-49a6-824c-62c0c40362d8 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: c3c1c002-df03-4597-a5a9-69e90552d7c4] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:57:16.182078 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a14ed296-175b-49a6-824c-62c0c40362d8 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:57:16.182524 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a14ed296-175b-49a6-824c-62c0c40362d8 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:57:16.183283 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a14ed296-175b-49a6-824c-62c0c40362d8 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:57:16.183749 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a14ed296-175b-49a6-824c-62c0c40362d8 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:57:16.322502 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a14ed296-175b-49a6-824c-62c0c40362d8 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:57:16.330121 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a14ed296-175b-49a6-824c-62c0c40362d8 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4" status: 200 len: 1263 microversion: 2.1 time: 0.159376 Jun 17 11:57:16.330688 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 568/1133] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:57:16 2022] GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4 => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:57:17.345997 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e502a5a8-d777-4fdf-9445-c8c020518267 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:57:17.346712 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e502a5a8-d777-4fdf-9445-c8c020518267 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: c3c1c002-df03-4597-a5a9-69e90552d7c4] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:57:17.354057 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e502a5a8-d777-4fdf-9445-c8c020518267 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:57:17.354515 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e502a5a8-d777-4fdf-9445-c8c020518267 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:57:17.355285 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e502a5a8-d777-4fdf-9445-c8c020518267 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:57:17.355751 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e502a5a8-d777-4fdf-9445-c8c020518267 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:57:17.490497 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e502a5a8-d777-4fdf-9445-c8c020518267 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:57:17.498190 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e502a5a8-d777-4fdf-9445-c8c020518267 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4" status: 200 len: 1263 microversion: 2.1 time: 0.156078 Jun 17 11:57:17.498765 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 566/1134] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:57:17 2022] GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:57:18.518507 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-7b9d3009-15fd-4e87-89dd-9a857d77f38c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:57:18.518895 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-7b9d3009-15fd-4e87-89dd-9a857d77f38c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: c3c1c002-df03-4597-a5a9-69e90552d7c4] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:57:18.522437 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:57:18.527809 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7b9d3009-15fd-4e87-89dd-9a857d77f38c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:57:18.528249 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7b9d3009-15fd-4e87-89dd-9a857d77f38c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:57:18.529017 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7b9d3009-15fd-4e87-89dd-9a857d77f38c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:57:18.529448 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7b9d3009-15fd-4e87-89dd-9a857d77f38c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:57:18.662132 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-7b9d3009-15fd-4e87-89dd-9a857d77f38c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:57:18.670392 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-7b9d3009-15fd-4e87-89dd-9a857d77f38c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4" status: 200 len: 1263 microversion: 2.1 time: 0.158238 Jun 17 11:57:18.670966 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 569/1135] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:57:18 2022] GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4 => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:57:19.687646 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-607c0f9e-1e56-4746-87a5-0c45cfea91df tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:57:19.688258 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-607c0f9e-1e56-4746-87a5-0c45cfea91df tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: c3c1c002-df03-4597-a5a9-69e90552d7c4] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:57:19.690124 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=2 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:57:19.690803 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=6 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:57:19.696015 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-607c0f9e-1e56-4746-87a5-0c45cfea91df tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:57:19.696479 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-607c0f9e-1e56-4746-87a5-0c45cfea91df tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:57:19.697268 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-607c0f9e-1e56-4746-87a5-0c45cfea91df tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:57:19.697710 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-607c0f9e-1e56-4746-87a5-0c45cfea91df tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:57:19.847807 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-607c0f9e-1e56-4746-87a5-0c45cfea91df tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:57:19.856216 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-607c0f9e-1e56-4746-87a5-0c45cfea91df tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4" status: 200 len: 1263 microversion: 2.1 time: 0.172793 Jun 17 11:57:19.856875 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 567/1136] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:57:19 2022] GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4 => generated 1263 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:57:20.874113 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-91d198bb-14d6-4e1b-9f13-d7c1d09a500f tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:57:20.874760 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-91d198bb-14d6-4e1b-9f13-d7c1d09a500f tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: c3c1c002-df03-4597-a5a9-69e90552d7c4] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:57:20.881953 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-91d198bb-14d6-4e1b-9f13-d7c1d09a500f tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:57:20.882677 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-91d198bb-14d6-4e1b-9f13-d7c1d09a500f tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:57:20.883528 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-91d198bb-14d6-4e1b-9f13-d7c1d09a500f tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:57:20.883968 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-91d198bb-14d6-4e1b-9f13-d7c1d09a500f tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:57:21.018267 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-91d198bb-14d6-4e1b-9f13-d7c1d09a500f tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:57:21.025905 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-91d198bb-14d6-4e1b-9f13-d7c1d09a500f tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4" status: 200 len: 1263 microversion: 2.1 time: 0.155696 Jun 17 11:57:21.026476 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 570/1137] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:57:20 2022] GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:57:22.091056 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-dff2f781-3ce5-4a5d-bed0-9faab271a0ef tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:57:22.091707 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-dff2f781-3ce5-4a5d-bed0-9faab271a0ef tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: c3c1c002-df03-4597-a5a9-69e90552d7c4] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:57:22.098297 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dff2f781-3ce5-4a5d-bed0-9faab271a0ef tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:57:22.103217 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dff2f781-3ce5-4a5d-bed0-9faab271a0ef tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:57:22.103217 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dff2f781-3ce5-4a5d-bed0-9faab271a0ef tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:57:22.103217 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dff2f781-3ce5-4a5d-bed0-9faab271a0ef tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:57:22.236250 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-dff2f781-3ce5-4a5d-bed0-9faab271a0ef tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:57:22.244577 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-dff2f781-3ce5-4a5d-bed0-9faab271a0ef tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4" status: 200 len: 1263 microversion: 2.1 time: 0.205756 Jun 17 11:57:22.245178 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 568/1138] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:57:22 2022] GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4 => generated 1263 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:57:22.493758 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-936c6ea3-265a-4a80-bbee-35d9aea06c9c req-8762d94f-7afe-47f3-95a2-68259d8eedb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3c1c002-df03-4597-a5a9-69e90552d7c4", "name": "network-vif-plugged", "status": "completed", "tag": "b4d2b9e3-f7f6-445d-b9a4-b29e99e6440c"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:57:22.502018 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-936c6ea3-265a-4a80-bbee-35d9aea06c9c req-8762d94f-7afe-47f3-95a2-68259d8eedb8 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:57:22.502453 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-936c6ea3-265a-4a80-bbee-35d9aea06c9c req-8762d94f-7afe-47f3-95a2-68259d8eedb8 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:57:22.515095 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-936c6ea3-265a-4a80-bbee-35d9aea06c9c req-8762d94f-7afe-47f3-95a2-68259d8eedb8 service nova] Creating event network-vif-plugged:b4d2b9e3-f7f6-445d-b9a4-b29e99e6440c for instance c3c1c002-df03-4597-a5a9-69e90552d7c4 on hv-cinder-83716 Jun 17 11:57:22.520216 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-936c6ea3-265a-4a80-bbee-35d9aea06c9c req-8762d94f-7afe-47f3-95a2-68259d8eedb8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031253 Jun 17 11:57:22.520849 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 571/1139] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:57:23.262457 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1414cfdd-b65d-48c8-9031-25049b015bc9 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:57:23.263003 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-1414cfdd-b65d-48c8-9031-25049b015bc9 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: c3c1c002-df03-4597-a5a9-69e90552d7c4] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:57:23.269618 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1414cfdd-b65d-48c8-9031-25049b015bc9 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:57:23.270073 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1414cfdd-b65d-48c8-9031-25049b015bc9 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:57:23.270855 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1414cfdd-b65d-48c8-9031-25049b015bc9 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:57:23.271297 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1414cfdd-b65d-48c8-9031-25049b015bc9 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:57:23.408933 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-1414cfdd-b65d-48c8-9031-25049b015bc9 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:57:23.417508 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-1414cfdd-b65d-48c8-9031-25049b015bc9 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4" status: 200 len: 1263 microversion: 2.1 time: 0.158808 Jun 17 11:57:23.418078 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 569/1140] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:57:23 2022] GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4 => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 11:57:24.435194 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2838c7dc-56f0-4945-92c1-b004da4f8d37 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:57:24.435961 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2838c7dc-56f0-4945-92c1-b004da4f8d37 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: c3c1c002-df03-4597-a5a9-69e90552d7c4] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:57:24.443014 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2838c7dc-56f0-4945-92c1-b004da4f8d37 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:57:24.443495 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2838c7dc-56f0-4945-92c1-b004da4f8d37 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:57:24.445782 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2838c7dc-56f0-4945-92c1-b004da4f8d37 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:57:24.446408 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2838c7dc-56f0-4945-92c1-b004da4f8d37 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:57:24.580944 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2838c7dc-56f0-4945-92c1-b004da4f8d37 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:57:24.589329 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2838c7dc-56f0-4945-92c1-b004da4f8d37 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4" status: 200 len: 1449 microversion: 2.1 time: 0.158412 Jun 17 11:57:24.589906 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 572/1141] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:57:24 2022] GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4 => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:57:24.605297 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-56004581-49b8-4f32-a2b9-f36ac87bc31c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:57:24.605914 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-56004581-49b8-4f32-a2b9-f36ac87bc31c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: c3c1c002-df03-4597-a5a9-69e90552d7c4] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:57:24.612515 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-56004581-49b8-4f32-a2b9-f36ac87bc31c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:57:24.612966 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-56004581-49b8-4f32-a2b9-f36ac87bc31c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:57:24.613787 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-56004581-49b8-4f32-a2b9-f36ac87bc31c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:57:24.614175 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-56004581-49b8-4f32-a2b9-f36ac87bc31c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:57:24.749173 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-56004581-49b8-4f32-a2b9-f36ac87bc31c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:57:24.757757 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-56004581-49b8-4f32-a2b9-f36ac87bc31c tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4" status: 200 len: 1449 microversion: 2.1 time: 0.156049 Jun 17 11:57:24.758326 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 570/1142] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:57:24 2022] GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:57:27.071241 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-f05751e5-9d3e-4c05-bc8e-4b90017223f1 req-39dcad0a-a640-4ad0-b5d9-701725f40b97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3c1c002-df03-4597-a5a9-69e90552d7c4", "tag": "b4d2b9e3-f7f6-445d-b9a4-b29e99e6440c"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:57:27.079608 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-f05751e5-9d3e-4c05-bc8e-4b90017223f1 req-39dcad0a-a640-4ad0-b5d9-701725f40b97 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:57:27.080056 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-f05751e5-9d3e-4c05-bc8e-4b90017223f1 req-39dcad0a-a640-4ad0-b5d9-701725f40b97 service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:57:27.092610 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-f05751e5-9d3e-4c05-bc8e-4b90017223f1 req-39dcad0a-a640-4ad0-b5d9-701725f40b97 service nova] Creating event network-changed:b4d2b9e3-f7f6-445d-b9a4-b29e99e6440c for instance c3c1c002-df03-4597-a5a9-69e90552d7c4 on hv-cinder-83716 Jun 17 11:57:27.097865 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-f05751e5-9d3e-4c05-bc8e-4b90017223f1 req-39dcad0a-a640-4ad0-b5d9-701725f40b97 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032181 Jun 17 11:57:27.098675 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 573/1143] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:57:45.318412 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 11:57:45.319119 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Fri Jun 17 11:57:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 11:57:55.695116 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 11:57:55.695858 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Fri Jun 17 11:57:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 11:58:13.827883 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 11:58:13.828523 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Fri Jun 17 11:58:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 11:58:37.313158 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 11:58:37.313915 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Fri Jun 17 11:58:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 11:58:55.107245 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:58:55.108337 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=56 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:58:55.114198 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-9d0e6321-fefe-42d2-a350-344cef9e629a tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:58:55.114780 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-9d0e6321-fefe-42d2-a350-344cef9e629a tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: c3c1c002-df03-4597-a5a9-69e90552d7c4] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:58:55.114916 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=22 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:58:55.115865 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=42 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 11:58:55.121634 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9d0e6321-fefe-42d2-a350-344cef9e629a tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:58:55.122300 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9d0e6321-fefe-42d2-a350-344cef9e629a tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:58:55.123249 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9d0e6321-fefe-42d2-a350-344cef9e629a tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:58:55.123972 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9d0e6321-fefe-42d2-a350-344cef9e629a tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:58:55.154495 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-9d0e6321-fefe-42d2-a350-344cef9e629a tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: c3c1c002-df03-4597-a5a9-69e90552d7c4] Going to try to terminate instance {{(pid=124844) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 11:58:55.169918 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-65bc2307-87ba-487b-8be0-67437875f0ac req-b79871da-df23-4aa6-89e8-2820279d0c7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3c1c002-df03-4597-a5a9-69e90552d7c4", "tag": "b4d2b9e3-f7f6-445d-b9a4-b29e99e6440c"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:58:55.180325 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-65bc2307-87ba-487b-8be0-67437875f0ac req-b79871da-df23-4aa6-89e8-2820279d0c7b service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:58:55.180770 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-65bc2307-87ba-487b-8be0-67437875f0ac req-b79871da-df23-4aa6-89e8-2820279d0c7b service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:58:55.193282 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-65bc2307-87ba-487b-8be0-67437875f0ac req-b79871da-df23-4aa6-89e8-2820279d0c7b service nova] Creating event network-changed:b4d2b9e3-f7f6-445d-b9a4-b29e99e6440c for instance c3c1c002-df03-4597-a5a9-69e90552d7c4 on hv-cinder-83716 Jun 17 11:58:55.200331 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-65bc2307-87ba-487b-8be0-67437875f0ac req-b79871da-df23-4aa6-89e8-2820279d0c7b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092499 Jun 17 11:58:55.200899 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 574/1144] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:58:55.649173 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-9d0e6321-fefe-42d2-a350-344cef9e629a tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4" status: 204 len: 0 microversion: 2.1 time: 0.543828 Jun 17 11:58:55.649826 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 571/1145] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 17 11:58:55 2022] DELETE /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 11:58:55.672167 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-7c5a1dfd-dab3-491a-be0a-1b93855f96ab tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:58:55.672879 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-7c5a1dfd-dab3-491a-be0a-1b93855f96ab tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: c3c1c002-df03-4597-a5a9-69e90552d7c4] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:58:55.680156 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7c5a1dfd-dab3-491a-be0a-1b93855f96ab tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:58:55.680641 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7c5a1dfd-dab3-491a-be0a-1b93855f96ab tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:58:55.681420 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7c5a1dfd-dab3-491a-be0a-1b93855f96ab tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:58:55.681859 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7c5a1dfd-dab3-491a-be0a-1b93855f96ab tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:58:55.818991 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-7c5a1dfd-dab3-491a-be0a-1b93855f96ab tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:58:55.826873 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-7c5a1dfd-dab3-491a-be0a-1b93855f96ab tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4" status: 200 len: 1574 microversion: 2.1 time: 0.159075 Jun 17 11:58:55.827545 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 575/1146] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:58:55 2022] GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:58:56.845672 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5501c3d9-214d-4c7d-91d6-ce2b08a5914f tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:58:56.846472 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-5501c3d9-214d-4c7d-91d6-ce2b08a5914f tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: c3c1c002-df03-4597-a5a9-69e90552d7c4] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:58:56.853558 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5501c3d9-214d-4c7d-91d6-ce2b08a5914f tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:58:56.854020 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5501c3d9-214d-4c7d-91d6-ce2b08a5914f tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:58:56.854801 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5501c3d9-214d-4c7d-91d6-ce2b08a5914f tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:58:56.855245 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5501c3d9-214d-4c7d-91d6-ce2b08a5914f tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:58:56.994339 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5501c3d9-214d-4c7d-91d6-ce2b08a5914f tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:58:57.002165 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5501c3d9-214d-4c7d-91d6-ce2b08a5914f tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4" status: 200 len: 1574 microversion: 2.1 time: 0.161876 Jun 17 11:58:57.002741 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 572/1147] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:58:56 2022] GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:58:57.936957 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-9f9d182a-d8c3-46e5-98cc-3b7a742f1d64 req-363e4f63-dcd0-4797-8be3-b55e3fdeb38a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3c1c002-df03-4597-a5a9-69e90552d7c4", "name": "network-vif-deleted", "tag": "b4d2b9e3-f7f6-445d-b9a4-b29e99e6440c"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:58:57.946496 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-9f9d182a-d8c3-46e5-98cc-3b7a742f1d64 req-363e4f63-dcd0-4797-8be3-b55e3fdeb38a service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:58:57.946940 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-9f9d182a-d8c3-46e5-98cc-3b7a742f1d64 req-363e4f63-dcd0-4797-8be3-b55e3fdeb38a service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:58:57.958643 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-9f9d182a-d8c3-46e5-98cc-3b7a742f1d64 req-363e4f63-dcd0-4797-8be3-b55e3fdeb38a service nova] Creating event network-vif-deleted:b4d2b9e3-f7f6-445d-b9a4-b29e99e6440c for instance c3c1c002-df03-4597-a5a9-69e90552d7c4 on hv-cinder-83716 Jun 17 11:58:57.963846 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-9f9d182a-d8c3-46e5-98cc-3b7a742f1d64 req-363e4f63-dcd0-4797-8be3-b55e3fdeb38a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031921 Jun 17 11:58:57.964437 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 576/1148] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:58:58.019827 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6413092d-9e07-4c9e-8cd9-cec92c45e675 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:58:58.020447 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-6413092d-9e07-4c9e-8cd9-cec92c45e675 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: c3c1c002-df03-4597-a5a9-69e90552d7c4] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:58:58.027026 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6413092d-9e07-4c9e-8cd9-cec92c45e675 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:58:58.027519 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6413092d-9e07-4c9e-8cd9-cec92c45e675 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:58:58.028293 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6413092d-9e07-4c9e-8cd9-cec92c45e675 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:58:58.028732 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6413092d-9e07-4c9e-8cd9-cec92c45e675 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:58:58.090193 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-6413092d-9e07-4c9e-8cd9-cec92c45e675 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:58:58.099034 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-6413092d-9e07-4c9e-8cd9-cec92c45e675 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4" status: 200 len: 1389 microversion: 2.1 time: 0.083092 Jun 17 11:58:58.099580 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 573/1149] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:58:58 2022] GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:58:59.117552 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b1db2ad7-69f0-4b33-bb89-3af9bc2a2113 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:58:59.118188 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b1db2ad7-69f0-4b33-bb89-3af9bc2a2113 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: c3c1c002-df03-4597-a5a9-69e90552d7c4] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:58:59.124484 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b1db2ad7-69f0-4b33-bb89-3af9bc2a2113 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:58:59.124930 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b1db2ad7-69f0-4b33-bb89-3af9bc2a2113 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:58:59.125897 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b1db2ad7-69f0-4b33-bb89-3af9bc2a2113 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:58:59.126175 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b1db2ad7-69f0-4b33-bb89-3af9bc2a2113 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:58:59.159520 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b1db2ad7-69f0-4b33-bb89-3af9bc2a2113 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:58:59.159970 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b1db2ad7-69f0-4b33-bb89-3af9bc2a2113 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:58:59.160424 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-b1db2ad7-69f0-4b33-bb89-3af9bc2a2113 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lazy-loading 'fault' on Instance uuid c3c1c002-df03-4597-a5a9-69e90552d7c4 {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 11:58:59.201328 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b1db2ad7-69f0-4b33-bb89-3af9bc2a2113 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:58:59.209530 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b1db2ad7-69f0-4b33-bb89-3af9bc2a2113 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4" status: 200 len: 1229 microversion: 2.1 time: 0.096851 Jun 17 11:58:59.210094 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 577/1150] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:58:59 2022] GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4 => generated 1229 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:59:00.226693 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-661f1a65-f28d-4a91-8c56-130ef5bd244d tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:59:00.227287 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-661f1a65-f28d-4a91-8c56-130ef5bd244d tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: c3c1c002-df03-4597-a5a9-69e90552d7c4] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:59:00.235386 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-661f1a65-f28d-4a91-8c56-130ef5bd244d tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:59:00.235929 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-661f1a65-f28d-4a91-8c56-130ef5bd244d tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:59:00.236715 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-661f1a65-f28d-4a91-8c56-130ef5bd244d tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:59:00.237159 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-661f1a65-f28d-4a91-8c56-130ef5bd244d tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:59:00.250412 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-661f1a65-f28d-4a91-8c56-130ef5bd244d tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] HTTP exception thrown: Instance c3c1c002-df03-4597-a5a9-69e90552d7c4 could not be found. Jun 17 11:59:00.252118 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-661f1a65-f28d-4a91-8c56-130ef5bd244d tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Request method failure captured: Jun 17 11:59:00.252118 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: request: GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4 HTTP/1.1 Jun 17 11:59:00.252118 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept: application/json Jun 17 11:59:00.252118 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jun 17 11:59:00.252118 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Connection: close Jun 17 11:59:00.252118 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jun 17 11:59:00.252118 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jun 17 11:59:00.252118 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Host: 10.222.0.45 Jun 17 11:59:00.252118 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jun 17 11:59:00.252118 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jun 17 11:59:00.252118 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABirGru0g_jcRc97gbpYX7yD5pv3n9CQmYO9kp27_4ftc3zkMRnxXRSOJ0BmcaaO-12FY-IwF-tlKbKkJiQt4iCv8O2NEc2KTIxlYdXk0GUSf3nD_LV2fde-KwM8V733p8BsJra8d5wq58gQbYZv5mhRWg77fa-rd2vlKnXLpsCtxg-Xv4 Jun 17 11:59:00.252118 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jun 17 11:59:00.252118 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jun 17 11:59:00.252118 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jun 17 11:59:00.252118 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jun 17 11:59:00.252118 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jun 17 11:59:00.252118 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jun 17 11:59:00.252118 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Id: 17575f4a36b94fdfb338dd1ba516d58e Jun 17 11:59:00.252118 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-TestVolumeBootPattern-704818079 Jun 17 11:59:00.252118 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Role: member,reader Jun 17 11:59:00.252118 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Roles: member,reader Jun 17 11:59:00.253926 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/17575f4a36b94fdfb338dd1ba516d58e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_17575f4a36b94fdfb338dd1ba516d58e", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/17575f4a36b94fdfb338dd1ba516d58e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/17575f4a36b94fdfb338dd1ba516d58e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:59:00.253926 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-TestVolumeBootPattern-704818079 Jun 17 11:59:00.253926 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Id: 17575f4a36b94fdfb338dd1ba516d58e Jun 17 11:59:00.253926 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-TestVolumeBootPattern-704818079 Jun 17 11:59:00.253926 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User: tempest-TestVolumeBootPattern-704818079-project Jun 17 11:59:00.253926 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jun 17 11:59:00.253926 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jun 17 11:59:00.253926 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Id: b5443b1aec1b414fad8bdd9f731ae7dc Jun 17 11:59:00.253926 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-TestVolumeBootPattern-704818079-project Jun 17 11:59:00.253926 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: method: > Jun 17 11:59:00.253926 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: exception: Instance c3c1c002-df03-4597-a5a9-69e90552d7c4 could not be found. Jun 17 11:59:00.253926 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: action_args: {'id': 'c3c1c002-df03-4597-a5a9-69e90552d7c4'} Jun 17 11:59:00.254962 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:59:00.254962 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:59:00.254962 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:59:00.254962 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:59:00.254962 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:59:00.254962 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:59:00.254962 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:59:00.254962 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:59:00.254962 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:59:00.254962 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:59:00.254962 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3c1c002-df03-4597-a5a9-69e90552d7c4 could not be found. Jun 17 11:59:00.254962 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:59:00.254962 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:59:00.254962 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:59:00.254962 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:59:00.254962 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:59:00.254962 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:59:00.254962 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:59:00.254962 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:59:00.254962 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:59:00.256788 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:59:00.256788 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 11:59:00.256788 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 11:59:00.256788 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:59:00.256788 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:59:00.256788 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:59:00.256788 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:59:00.256788 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3c1c002-df03-4597-a5a9-69e90552d7c4 could not be found. Jun 17 11:59:00.256788 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:59:00.256788 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:59:00.256788 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:59:00.256788 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:59:00.256788 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:59:00.256788 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:59:00.256788 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:59:00.256788 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:59:00.256788 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3c1c002-df03-4597-a5a9-69e90552d7c4 could not be found. Jun 17 11:59:00.256788 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:59:00.258451 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-661f1a65-f28d-4a91-8c56-130ef5bd244d tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Returning 404 to user: Instance c3c1c002-df03-4597-a5a9-69e90552d7c4 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:59:00.258451 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-661f1a65-f28d-4a91-8c56-130ef5bd244d tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4" status: 404 len: 111 microversion: 2.1 time: 0.030799 Jun 17 11:59:00.258451 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 574/1151] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:59:00 2022] GET /compute/v2.1/servers/c3c1c002-df03-4597-a5a9-69e90552d7c4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:59:03.855209 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2a835d37-23e7-4110-aa7f-85e598b933ac tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:59:03.855814 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2a835d37-23e7-4110-aa7f-85e598b933ac tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: f6ff4fa8-631c-4ff5-9737-13b5eb8292f3] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:59:03.857277 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-5be64329-aa5c-4e66-9fc3-58139cecad13 req-8febbc31-4e9a-4631-bb6c-6480724f64ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6ff4fa8-631c-4ff5-9737-13b5eb8292f3", "tag": "92b10753-3cf1-4e2e-9257-638b27251c45"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:59:03.862643 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2a835d37-23e7-4110-aa7f-85e598b933ac tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:59:03.863127 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2a835d37-23e7-4110-aa7f-85e598b933ac tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:59:03.863938 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2a835d37-23e7-4110-aa7f-85e598b933ac tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:59:03.864445 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2a835d37-23e7-4110-aa7f-85e598b933ac tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:59:03.867032 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-5be64329-aa5c-4e66-9fc3-58139cecad13 req-8febbc31-4e9a-4631-bb6c-6480724f64ac service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:59:03.867590 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-5be64329-aa5c-4e66-9fc3-58139cecad13 req-8febbc31-4e9a-4631-bb6c-6480724f64ac service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:59:03.880252 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-5be64329-aa5c-4e66-9fc3-58139cecad13 req-8febbc31-4e9a-4631-bb6c-6480724f64ac service nova] Creating event network-changed:92b10753-3cf1-4e2e-9257-638b27251c45 for instance f6ff4fa8-631c-4ff5-9737-13b5eb8292f3 on hv-cinder-83716 Jun 17 11:59:03.886046 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-5be64329-aa5c-4e66-9fc3-58139cecad13 req-8febbc31-4e9a-4631-bb6c-6480724f64ac service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032523 Jun 17 11:59:03.886749 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 575/1152] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:59:03.891700 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2a835d37-23e7-4110-aa7f-85e598b933ac tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: f6ff4fa8-631c-4ff5-9737-13b5eb8292f3] Going to try to terminate instance {{(pid=124845) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 11:59:04.221894 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2a835d37-23e7-4110-aa7f-85e598b933ac tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3" status: 204 len: 0 microversion: 2.1 time: 0.370292 Jun 17 11:59:04.222999 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 578/1153] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 17 11:59:03 2022] DELETE /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 11:59:04.231850 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-56a8f4c2-fc20-4589-890a-4dbbd817c4e7 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:59:04.232588 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-56a8f4c2-fc20-4589-890a-4dbbd817c4e7 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: f6ff4fa8-631c-4ff5-9737-13b5eb8292f3] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:59:04.243120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-56a8f4c2-fc20-4589-890a-4dbbd817c4e7 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:59:04.243811 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-56a8f4c2-fc20-4589-890a-4dbbd817c4e7 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:59:04.244630 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-56a8f4c2-fc20-4589-890a-4dbbd817c4e7 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:59:04.245073 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-56a8f4c2-fc20-4589-890a-4dbbd817c4e7 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:59:04.666537 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-56a8f4c2-fc20-4589-890a-4dbbd817c4e7 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:59:04.675579 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-56a8f4c2-fc20-4589-890a-4dbbd817c4e7 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3" status: 200 len: 1575 microversion: 2.1 time: 0.448064 Jun 17 11:59:04.676568 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 576/1154] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:59:04 2022] GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3 => generated 1575 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:59:05.693784 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-5326bf36-bc3a-4581-bb43-e5a7aca1dcfc tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:59:05.694529 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-5326bf36-bc3a-4581-bb43-e5a7aca1dcfc tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: f6ff4fa8-631c-4ff5-9737-13b5eb8292f3] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:59:05.701174 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5326bf36-bc3a-4581-bb43-e5a7aca1dcfc tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:59:05.701630 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5326bf36-bc3a-4581-bb43-e5a7aca1dcfc tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:59:05.702426 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5326bf36-bc3a-4581-bb43-e5a7aca1dcfc tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:59:05.702864 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5326bf36-bc3a-4581-bb43-e5a7aca1dcfc tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:59:05.839987 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5326bf36-bc3a-4581-bb43-e5a7aca1dcfc tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:59:05.848613 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-5326bf36-bc3a-4581-bb43-e5a7aca1dcfc tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3" status: 200 len: 1575 microversion: 2.1 time: 0.159163 Jun 17 11:59:05.849191 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 579/1155] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:59:05 2022] GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:59:06.482775 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-2dff5ac5-d141-46fe-be61-f9f731e8d117 req-6f586a69-1bb9-40a4-b765-2aac8fbc91ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6ff4fa8-631c-4ff5-9737-13b5eb8292f3", "name": "network-vif-deleted", "tag": "92b10753-3cf1-4e2e-9257-638b27251c45"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 11:59:06.492532 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-2dff5ac5-d141-46fe-be61-f9f731e8d117 req-6f586a69-1bb9-40a4-b765-2aac8fbc91ca service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:59:06.495510 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-2dff5ac5-d141-46fe-be61-f9f731e8d117 req-6f586a69-1bb9-40a4-b765-2aac8fbc91ca service nova] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:59:06.504254 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-2dff5ac5-d141-46fe-be61-f9f731e8d117 req-6f586a69-1bb9-40a4-b765-2aac8fbc91ca service nova] Creating event network-vif-deleted:92b10753-3cf1-4e2e-9257-638b27251c45 for instance f6ff4fa8-631c-4ff5-9737-13b5eb8292f3 on hv-cinder-83716 Jun 17 11:59:06.509497 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-2dff5ac5-d141-46fe-be61-f9f731e8d117 req-6f586a69-1bb9-40a4-b765-2aac8fbc91ca service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030082 Jun 17 11:59:06.510087 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 577/1156] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 17 11:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 11:59:06.865690 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-78f9a93e-3b29-4d3f-b015-f948b45d57e6 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:59:06.866313 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-78f9a93e-3b29-4d3f-b015-f948b45d57e6 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: f6ff4fa8-631c-4ff5-9737-13b5eb8292f3] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:59:06.873420 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-78f9a93e-3b29-4d3f-b015-f948b45d57e6 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:59:06.873878 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-78f9a93e-3b29-4d3f-b015-f948b45d57e6 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:59:06.874667 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-78f9a93e-3b29-4d3f-b015-f948b45d57e6 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:59:06.876485 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-78f9a93e-3b29-4d3f-b015-f948b45d57e6 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:59:06.941469 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-78f9a93e-3b29-4d3f-b015-f948b45d57e6 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5443b1aec1b414fad8bdd9f731ae7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17575f4a36b94fdfb338dd1ba516d58e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 11:59:06.949264 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-78f9a93e-3b29-4d3f-b015-f948b45d57e6 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3" status: 200 len: 1225 microversion: 2.1 time: 0.087519 Jun 17 11:59:06.949844 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 580/1157] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:59:06 2022] GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 11:59:07.967139 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a36ef696-5c88-438c-8e84-0e29ffea6a12 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:59:07.967869 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a36ef696-5c88-438c-8e84-0e29ffea6a12 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: f6ff4fa8-631c-4ff5-9737-13b5eb8292f3] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:59:07.974128 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a36ef696-5c88-438c-8e84-0e29ffea6a12 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:59:07.974584 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a36ef696-5c88-438c-8e84-0e29ffea6a12 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:59:07.975377 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a36ef696-5c88-438c-8e84-0e29ffea6a12 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:59:07.975810 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a36ef696-5c88-438c-8e84-0e29ffea6a12 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:59:07.989103 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-a36ef696-5c88-438c-8e84-0e29ffea6a12 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] HTTP exception thrown: Instance f6ff4fa8-631c-4ff5-9737-13b5eb8292f3 could not be found. Jun 17 11:59:07.994982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a36ef696-5c88-438c-8e84-0e29ffea6a12 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Request method failure captured: Jun 17 11:59:07.994982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: request: GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3 HTTP/1.1 Jun 17 11:59:07.994982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept: application/json Jun 17 11:59:07.994982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jun 17 11:59:07.994982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Connection: close Jun 17 11:59:07.994982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jun 17 11:59:07.994982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jun 17 11:59:07.994982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Host: 10.222.0.45 Jun 17 11:59:07.994982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jun 17 11:59:07.994982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jun 17 11:59:07.994982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABirGru0g_jcRc97gbpYX7yD5pv3n9CQmYO9kp27_4ftc3zkMRnxXRSOJ0BmcaaO-12FY-IwF-tlKbKkJiQt4iCv8O2NEc2KTIxlYdXk0GUSf3nD_LV2fde-KwM8V733p8BsJra8d5wq58gQbYZv5mhRWg77fa-rd2vlKnXLpsCtxg-Xv4 Jun 17 11:59:07.994982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jun 17 11:59:07.994982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jun 17 11:59:07.994982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jun 17 11:59:07.994982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jun 17 11:59:07.994982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jun 17 11:59:07.994982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jun 17 11:59:07.994982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Id: 17575f4a36b94fdfb338dd1ba516d58e Jun 17 11:59:07.994982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-TestVolumeBootPattern-704818079 Jun 17 11:59:07.994982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Role: member,reader Jun 17 11:59:07.994982 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Roles: member,reader Jun 17 11:59:07.996840 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/17575f4a36b94fdfb338dd1ba516d58e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_17575f4a36b94fdfb338dd1ba516d58e", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/17575f4a36b94fdfb338dd1ba516d58e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/17575f4a36b94fdfb338dd1ba516d58e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:59:07.996840 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-TestVolumeBootPattern-704818079 Jun 17 11:59:07.996840 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Id: 17575f4a36b94fdfb338dd1ba516d58e Jun 17 11:59:07.996840 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-TestVolumeBootPattern-704818079 Jun 17 11:59:07.996840 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User: tempest-TestVolumeBootPattern-704818079-project Jun 17 11:59:07.996840 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jun 17 11:59:07.996840 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jun 17 11:59:07.996840 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Id: b5443b1aec1b414fad8bdd9f731ae7dc Jun 17 11:59:07.996840 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-TestVolumeBootPattern-704818079-project Jun 17 11:59:07.996840 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: method: > Jun 17 11:59:07.996840 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: exception: Instance f6ff4fa8-631c-4ff5-9737-13b5eb8292f3 could not be found. Jun 17 11:59:07.996840 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: action_args: {'id': 'f6ff4fa8-631c-4ff5-9737-13b5eb8292f3'} Jun 17 11:59:07.998359 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:59:07.998359 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:59:07.998359 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:59:07.998359 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:59:07.998359 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:59:07.998359 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:59:07.998359 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:59:07.998359 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:59:07.998359 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:59:07.998359 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:59:07.998359 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6ff4fa8-631c-4ff5-9737-13b5eb8292f3 could not be found. Jun 17 11:59:07.998359 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:59:07.998359 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:59:07.998359 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:59:07.998359 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:59:07.998359 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:59:07.998359 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:59:07.998359 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:59:07.998359 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:59:07.998359 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:59:08.000120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:59:08.000120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 11:59:08.000120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 11:59:08.000120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:59:08.000120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:59:08.000120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:59:08.000120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:59:08.000120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6ff4fa8-631c-4ff5-9737-13b5eb8292f3 could not be found. Jun 17 11:59:08.000120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:59:08.000120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:59:08.000120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:59:08.000120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:59:08.000120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:59:08.000120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:59:08.000120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:59:08.000120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:59:08.000120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6ff4fa8-631c-4ff5-9737-13b5eb8292f3 could not be found. Jun 17 11:59:08.000120 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:59:08.002221 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a36ef696-5c88-438c-8e84-0e29ffea6a12 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Returning 404 to user: Instance f6ff4fa8-631c-4ff5-9737-13b5eb8292f3 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:59:08.002221 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a36ef696-5c88-438c-8e84-0e29ffea6a12 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3" status: 404 len: 111 microversion: 2.1 time: 0.029765 Jun 17 11:59:08.002221 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 578/1158] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:59:07 2022] GET /compute/v2.1/servers/f6ff4fa8-631c-4ff5-9737-13b5eb8292f3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:59:08.538810 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e5e6e1c9-b157-4468-b2d0-4082ee17f61a tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:59:08.539386 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-e5e6e1c9-b157-4468-b2d0-4082ee17f61a tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: ba34be77-d3fd-48cd-b7dd-72a0544cc411] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:59:08.545887 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e5e6e1c9-b157-4468-b2d0-4082ee17f61a tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:59:08.546340 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e5e6e1c9-b157-4468-b2d0-4082ee17f61a tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:59:08.547138 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e5e6e1c9-b157-4468-b2d0-4082ee17f61a tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:59:08.547604 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e5e6e1c9-b157-4468-b2d0-4082ee17f61a tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:59:08.561009 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-e5e6e1c9-b157-4468-b2d0-4082ee17f61a tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] HTTP exception thrown: Instance ba34be77-d3fd-48cd-b7dd-72a0544cc411 could not be found. Jun 17 11:59:08.562671 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e5e6e1c9-b157-4468-b2d0-4082ee17f61a tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Request method failure captured: Jun 17 11:59:08.562671 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: request: DELETE /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411 HTTP/1.1 Jun 17 11:59:08.562671 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jun 17 11:59:08.562671 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jun 17 11:59:08.562671 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Connection: close Jun 17 11:59:08.562671 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jun 17 11:59:08.562671 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jun 17 11:59:08.562671 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.45 Jun 17 11:59:08.562671 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jun 17 11:59:08.562671 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jun 17 11:59:08.562671 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABirGru0g_jcRc97gbpYX7yD5pv3n9CQmYO9kp27_4ftc3zkMRnxXRSOJ0BmcaaO-12FY-IwF-tlKbKkJiQt4iCv8O2NEc2KTIxlYdXk0GUSf3nD_LV2fde-KwM8V733p8BsJra8d5wq58gQbYZv5mhRWg77fa-rd2vlKnXLpsCtxg-Xv4 Jun 17 11:59:08.562671 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jun 17 11:59:08.562671 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jun 17 11:59:08.562671 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jun 17 11:59:08.562671 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jun 17 11:59:08.562671 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jun 17 11:59:08.562671 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jun 17 11:59:08.562671 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Id: 17575f4a36b94fdfb338dd1ba516d58e Jun 17 11:59:08.562671 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-TestVolumeBootPattern-704818079 Jun 17 11:59:08.562671 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jun 17 11:59:08.562671 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jun 17 11:59:08.565511 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/17575f4a36b94fdfb338dd1ba516d58e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_17575f4a36b94fdfb338dd1ba516d58e", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/17575f4a36b94fdfb338dd1ba516d58e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/17575f4a36b94fdfb338dd1ba516d58e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:59:08.565511 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-TestVolumeBootPattern-704818079 Jun 17 11:59:08.565511 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: 17575f4a36b94fdfb338dd1ba516d58e Jun 17 11:59:08.565511 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-TestVolumeBootPattern-704818079 Jun 17 11:59:08.565511 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User: tempest-TestVolumeBootPattern-704818079-project Jun 17 11:59:08.565511 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jun 17 11:59:08.565511 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jun 17 11:59:08.565511 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Id: b5443b1aec1b414fad8bdd9f731ae7dc Jun 17 11:59:08.565511 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-TestVolumeBootPattern-704818079-project Jun 17 11:59:08.565511 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: method: > Jun 17 11:59:08.565511 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: exception: Instance ba34be77-d3fd-48cd-b7dd-72a0544cc411 could not be found. Jun 17 11:59:08.565511 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: action_args: {'id': 'ba34be77-d3fd-48cd-b7dd-72a0544cc411'} Jun 17 11:59:08.566524 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:59:08.566524 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:59:08.566524 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:59:08.566524 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:59:08.566524 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:59:08.566524 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:59:08.566524 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:59:08.566524 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:59:08.566524 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:59:08.566524 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:59:08.566524 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba34be77-d3fd-48cd-b7dd-72a0544cc411 could not be found. Jun 17 11:59:08.566524 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:59:08.566524 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:59:08.566524 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:59:08.566524 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:59:08.566524 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:59:08.566524 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:59:08.566524 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:59:08.566524 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:59:08.566524 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:59:08.567993 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:59:08.567993 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 11:59:08.567993 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 11:59:08.567993 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 11:59:08.567993 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 11:59:08.567993 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:59:08.567993 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:59:08.567993 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:59:08.567993 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:59:08.567993 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba34be77-d3fd-48cd-b7dd-72a0544cc411 could not be found. Jun 17 11:59:08.567993 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:59:08.567993 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:59:08.567993 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:59:08.567993 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:59:08.567993 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:59:08.567993 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:59:08.567993 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:59:08.567993 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:59:08.567993 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba34be77-d3fd-48cd-b7dd-72a0544cc411 could not be found. Jun 17 11:59:08.567993 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jun 17 11:59:08.569852 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e5e6e1c9-b157-4468-b2d0-4082ee17f61a tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Returning 404 to user: Instance ba34be77-d3fd-48cd-b7dd-72a0544cc411 could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:59:08.569852 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-e5e6e1c9-b157-4468-b2d0-4082ee17f61a tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411" status: 404 len: 111 microversion: 2.1 time: 0.029948 Jun 17 11:59:08.569852 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 581/1159] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 17 11:59:08 2022] DELETE /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:59:08.573920 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6e587454-f06c-4f8a-b85a-91fd4e0425f5 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:59:08.574531 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-6e587454-f06c-4f8a-b85a-91fd4e0425f5 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] [instance: ba34be77-d3fd-48cd-b7dd-72a0544cc411] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 11:59:08.581646 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6e587454-f06c-4f8a-b85a-91fd4e0425f5 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:59:08.582097 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6e587454-f06c-4f8a-b85a-91fd4e0425f5 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:59:08.582910 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6e587454-f06c-4f8a-b85a-91fd4e0425f5 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 11:59:08.583344 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6e587454-f06c-4f8a-b85a-91fd4e0425f5 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Lock "c323a48d-876b-4d2b-a1cd-4651eaf7de7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 11:59:08.597328 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-6e587454-f06c-4f8a-b85a-91fd4e0425f5 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] HTTP exception thrown: Instance ba34be77-d3fd-48cd-b7dd-72a0544cc411 could not be found. Jun 17 11:59:08.598868 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6e587454-f06c-4f8a-b85a-91fd4e0425f5 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Request method failure captured: Jun 17 11:59:08.598868 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: request: GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411 HTTP/1.1 Jun 17 11:59:08.598868 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept: application/json Jun 17 11:59:08.598868 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jun 17 11:59:08.598868 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Connection: close Jun 17 11:59:08.598868 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jun 17 11:59:08.598868 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jun 17 11:59:08.598868 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Host: 10.222.0.45 Jun 17 11:59:08.598868 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jun 17 11:59:08.598868 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jun 17 11:59:08.598868 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABirGru0g_jcRc97gbpYX7yD5pv3n9CQmYO9kp27_4ftc3zkMRnxXRSOJ0BmcaaO-12FY-IwF-tlKbKkJiQt4iCv8O2NEc2KTIxlYdXk0GUSf3nD_LV2fde-KwM8V733p8BsJra8d5wq58gQbYZv5mhRWg77fa-rd2vlKnXLpsCtxg-Xv4 Jun 17 11:59:08.598868 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jun 17 11:59:08.598868 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jun 17 11:59:08.598868 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jun 17 11:59:08.598868 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jun 17 11:59:08.598868 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jun 17 11:59:08.598868 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jun 17 11:59:08.598868 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Id: 17575f4a36b94fdfb338dd1ba516d58e Jun 17 11:59:08.598868 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-TestVolumeBootPattern-704818079 Jun 17 11:59:08.598868 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Role: member,reader Jun 17 11:59:08.598868 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Roles: member,reader Jun 17 11:59:08.600590 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/17575f4a36b94fdfb338dd1ba516d58e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_17575f4a36b94fdfb338dd1ba516d58e", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/17575f4a36b94fdfb338dd1ba516d58e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/17575f4a36b94fdfb338dd1ba516d58e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 17 11:59:08.600590 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-TestVolumeBootPattern-704818079 Jun 17 11:59:08.600590 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Id: 17575f4a36b94fdfb338dd1ba516d58e Jun 17 11:59:08.600590 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-TestVolumeBootPattern-704818079 Jun 17 11:59:08.600590 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User: tempest-TestVolumeBootPattern-704818079-project Jun 17 11:59:08.600590 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jun 17 11:59:08.600590 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jun 17 11:59:08.600590 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Id: b5443b1aec1b414fad8bdd9f731ae7dc Jun 17 11:59:08.600590 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-TestVolumeBootPattern-704818079-project Jun 17 11:59:08.600590 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: method: > Jun 17 11:59:08.600590 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: exception: Instance ba34be77-d3fd-48cd-b7dd-72a0544cc411 could not be found. Jun 17 11:59:08.600590 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: action_args: {'id': 'ba34be77-d3fd-48cd-b7dd-72a0544cc411'} Jun 17 11:59:08.601519 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 11:59:08.601519 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:59:08.601519 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 11:59:08.601519 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 11:59:08.601519 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 11:59:08.601519 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 11:59:08.601519 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 11:59:08.601519 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 11:59:08.601519 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 11:59:08.601519 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 11:59:08.601519 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba34be77-d3fd-48cd-b7dd-72a0544cc411 could not be found. Jun 17 11:59:08.601519 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:59:08.601519 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:59:08.601519 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:59:08.601519 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:59:08.601519 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:59:08.601519 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:59:08.601519 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 11:59:08.601519 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 11:59:08.601519 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 11:59:08.603150 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 11:59:08.603150 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 11:59:08.603150 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 11:59:08.603150 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 11:59:08.603150 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 11:59:08.603150 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 11:59:08.603150 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 11:59:08.603150 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba34be77-d3fd-48cd-b7dd-72a0544cc411 could not be found. Jun 17 11:59:08.603150 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:59:08.603150 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 11:59:08.603150 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:59:08.603150 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 11:59:08.603150 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 11:59:08.603150 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 11:59:08.603150 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 11:59:08.603150 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 11:59:08.603150 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba34be77-d3fd-48cd-b7dd-72a0544cc411 could not be found. Jun 17 11:59:08.603150 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jun 17 11:59:08.605131 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6e587454-f06c-4f8a-b85a-91fd4e0425f5 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Returning 404 to user: Instance ba34be77-d3fd-48cd-b7dd-72a0544cc411 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 11:59:08.605131 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-6e587454-f06c-4f8a-b85a-91fd4e0425f5 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411" status: 404 len: 111 microversion: 2.1 time: 0.030626 Jun 17 11:59:08.605131 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 579/1160] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 17 11:59:08 2022] GET /compute/v2.1/servers/ba34be77-d3fd-48cd-b7dd-72a0544cc411 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 11:59:10.271046 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-00c090cb-c979-4aea-9045-ab6fc5fab559 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] Calling method '.version_select at 0x7f9c76981c10>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 11:59:10.398152 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-00c090cb-c979-4aea-9045-ab6fc5fab559 tempest-TestVolumeBootPattern-704818079 tempest-TestVolumeBootPattern-704818079-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-577758725" status: 202 len: 0 microversion: 2.1 time: 0.131506 Jun 17 11:59:10.398742 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 582/1161] 10.222.0.45 () {58 vars in 1259 bytes} [Fri Jun 17 11:59:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-577758725 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 11:59:29.378179 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 11:59:29.378761 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Fri Jun 17 11:59:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 12:01:15.704151 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 12:01:15.704772 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Fri Jun 17 12:01:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 12:01:33.836454 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 12:01:33.837106 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Fri Jun 17 12:01:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 12:01:57.321776 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 12:01:57.322543 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Fri Jun 17 12:01:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 12:02:49.388024 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 12:02:49.388722 dv-cinder-837166-3-iscsi devstack@n-api.service[124844]: Fri Jun 17 12:02:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 12:04:25.330499 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 12:04:25.331105 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Fri Jun 17 12:04:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 12:04:35.712522 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 12:04:35.713164 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Fri Jun 17 12:04:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 12:04:46.614968 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 12:04:46.615768 dv-cinder-837166-3-iscsi devstack@n-api.service[124845]: Fri Jun 17 12:04:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!